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AN EXPERIMENTAL COMPARISON OP THE 
S'rUDY.TKST AND TEST^TUDY METHODS 
IN SPET.LINO 

AimilJR I GATES 
Ttakebere CeUene, Colurabui Uiiiv«.»5ty 

Tho pitMilCDl study is one of a scrips of Investigations planned to 
inquire Into the powibililics of improving InetruoUon In spelling. 
Investigations nocepted na diaserlaVions for the Docloralc at Tenohers 
College by Robert TlioinjjBon, Herbert A. (Jarrell, Jmnc« E. Menden- 
hall, Claire T. Zyvo, Ina C. Karlorian, and W. II. (Jolemnn,* deal with 
closely itdated problems, and olliera will bo completed ahortly. 

The present Investigation ia an inquiry poncenimg the gross 
efftciency of the two most widely used general melhoclsj tho Pre-study 
or 8ludy«test method and the Pre-teal or HVal-aludy plan. In some 
measure, the invoaligalon providea data which auggrat the miiorcnt 
hmltallons and merits of liie two rival proeedurea and wbwb indicato 
possible imprtivemenU in eueli. The, alutly also provides several clues 
for further reiseareh for tlie purtKiae of appraising modificntioiui of 
posailile value. 

Tho litt‘ratum affords few experuueiilnl comparisons of the Pre- 
sLudy and tlie Pre-test methods. Kiauier's study* based upon nine- 

• Tltompwm, R.: "The Effwnuw*#^ of .Moiimi .S|m*IIii)b Iiihlnielitiii,'' Tonoli- 
nr» Colli'Ro, Ckilumbitt I’mvehtiiv, CniilnbuluaiH U> Ediiratiun, No 430, t^nrfoll, 
11, A. '‘OcncniliifttirtM of Unaht nmt l)«ll CUihltfU A feniimmUve Hlwij \vilh 
Hpeciol Hefereiicp to Pppllmg," Trarhen* tJolhw. foluiiiliift llniM'rHilv, Contnlm- 
lions to Ifduealiou, No. 'UHI; .Mriidpiilmll. J K . ".\u .\iinl> ma of .H|H'lting Erwra,’’ 
IVachoMi (‘ollrRe Ihireau nf I'ulilirHUoiia, 103U; 56 vm‘, (' T.: "A t’oiupsnUivp 
Smdy of MeUiO'ln" (iii nresa): Hiirloniis, I '''llie Hiwea of (Inu'Diluinlioii iu 
ftpcllliig" (in profinmlioii); t (ilpomn, \V. 11 “ ''iSintlM*# of H|h>IIiiik Vornlnilnro'i' 
(ill prtipnmliun). 

•lavUvidviftl Method m. Group MpUkhI of 'IViipUmg HiMdliug /''niirf/i V««r 
Book of (Ae Jiejmrlmonl of Supcrwltn'lrnfr, \ViiNbiiig(<iii, 1). i' , llWtJ 

1 



2 


Th^ Jmmal tsf 


hundmfl g«v«tily««lx pwpite <n Orii*l«^ II i« VIU r»f !,}»* Chiai ||9 
iKihtKJh »w'tn#i toshttw thsii tsft finfwri'rartty «4 8bir* Prt‘-?8ady 
tse’lhod in GratlfS 11 anH III, anti ^tipf'florisy r<f !b(» Pm-Smt plan ia 
Qradi?« IV lo VI 1 1 A sUitly by W^wly.’ in^ pup?}^ su HriMk# 

VI, Vll, and VIII gav«? on adva«'.agi»? !« rt^hf'r plain. Kid- ■ 

Bar® Id a niudy wnfiml t« nimhijradu* papilw f«i»d. amnxtrdbiK h® 
rnelhod^ of coinpuUnjs rt^ulK iHai whil*’ 5.<^.«^“^ndy TOrihod puf® 
belter immediate rr^till#, ihr* fldvMia^f ww w*4 appatent in \f^ 
after an interval of als monlhis 

Tiik Sn ot-TMT r«<»<mA!wi 

For the fttudy-lrsl procedure th»» eame wiwMla woro uml aa fop 
the TeaWtudy nieihoti. 'IVi numtHT per weefe varied with the jwr»iife. 
Each week’s a«»iKnmcnl was diviiSed into four r^nal part^f, tJne enf 
the«o uhort lint* mm aludivd «n Monday, ’Ttiewby, Wcdwisiky, and 
Thursday, roaspeclively. Friday wa« devoted to a tosi on the week’s ' 
atwlgament, followed by review wb»n rim** perwitirxl 

The method of inlroduciog the wortls vem ewMantiaily m follows; 

L Tlitt iW vraM «?3mU*i U 

ttidfe it prwmrAWic-Ytrtl bji 

Th» Wdnl II M ifi I 19 irti^alU 

il^keil to WIJJ0 Um wardi in II p'Hiifpm’t* 

8* Thft t^a»?AM0r iW WI0)|4 wn ilair^ ^4 Hritwl n iua<? it, 

4* Tins tmpik 0i lb*' WiAiral mM<\ 11, h' Uk 

m\vm* 

8. Tho kmlnitkil Ihi^ w«3ir4 igm4 tostt llkir Mki-pi Hei 

t^upiU WOT ettmiimgif^d 10 gn^up iW m 

C. Thpy lodbnl Uj*^ w^ntl a si? iWjr U K/v 4'«r’!i r^Ti 

7. Barrm m <5>. 

8. IVtiiJii cicf<fef:4 mod ihi» MUta |irn « 

ity^Uuw Uics io^hti^r itftJscid om* jmpU u* iflik»-iiii4 t%f* u^u\ 

0. Pupllfl WmtO lb« WiOptI M liw> f^Hi ihif* ^ pJifV 

cil^CNi by ayllablf^ wbit‘*iii«vf*r iKwlId*? 

10, Thoy eom^kftitKl UiPir with bwi .t+ Uu^\ 

llv Pupik cjoviengd th*£ir Wifurd, wvaXta u gijftd il wgit 

tom. 

Itt. Thoy n^p^tCKl (U) until liipy t^nitild wril*> ifirAjirl nnur 

‘ Tlift Evalufltlon of Two Mi^lhorU of TmicUn^ g Kif 

lh$ ^ ^tiotlttl ^ 01 / I <ii 

1087c 

* L. Ri.: Thd T^Ugtuily tho HuiKly^Wi^l in Tri^i^’^lMug 

iS(C/u>p/ 1020, pp. 
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The above plan was modifled in delaila to meet the partloular 
ncode of the difterent groups, which varied from the dulicat accond- 
grade to the bnghteat eighth-grade clnwea. 

Near the end of the [jeriod the pupila wort* given a test of the words 
studied during the day. If a word was miased by more than half the 
cln««, it was arldcd to the liat for the next day. 

On Friday n test of all word* taught during the week was oon- 
duoted. Words frequently miased were pul Into a review list. Those 
proving to be, particularly difncult were rotaught, if possible, during 
the foUowiiig week. Others were retained for a review period about a 
month later. 


The Tertvstody Pl\n 

The Tcsl-fltudy plan employed was in general outline the plan 
recommended by Horn* m 1019 and sUice widely used. The eohcdulo 
is as follows: 

ifoiukty. — Twl on all words m Ilia now nwignmcnl for lha wwsk. 

7’i»ju/si/,' •Individuals study Ilia words mu.«wl on lha Monrlsy Irst. Pupils 
tnoking no anrora on llin Monday trml arc cxcustwl. 

lP«dn*«</as.'“TcMl on new and raviaw wonla All pupiln taka Uiii teal 

T’Aiiw/ay, —Windy of words rniiw«Kl on Wrtlnrwlny leal, Pupih making no 
orroni ara exomtad 

Priday ~Tc«l on same woixIh iw uwad «u \Vf>«tiu‘i(day for all pupils. KUidy 
mimd words as far ns lima fiannils 

Once a month a review test wua given comprising tlio moat tliflicult 
words used during the preceding monlli. 

'I'llK KxPKUlMBN'rAl, ScilEDUUK 

The experiment was conducted during the period from February 
1 to June 30, 1928. The period was divided into two parts. Each 
period consisted approximately of nine weeks for teaoliing and one 
week for Icstiug. During the iirst period half of the classes used the 
Study-test method and half the Test-study. During the second 
period tlie melluKla were reversed. Thus, each pupil spout approxi- 
mately ton weeks with one method and ton witli the other. This 
Bohome makes two types of coinparisonH ])UHsiblo; (1) Itesulls oblaiiiod 
from groups using the two (lifforent metliods at tlie stune lime and with 

' Pnnniilm (if Matlioit in Tcat'hinK Kpalliiig nx Daiivad from Waianlilii' Invi-ali- 
galiotm litgliifcnUt YrarlkHtK uj lha iVnliorwit .SVirty /or thv i\{nrlii uf A'l/iirulioa, 
Pari II 
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ib« wroifi wtirtbn may h^ wwfras'f <i, ««<! C2^ irrjisl^* f^t'-ptu mnw ptmp 
obisini^ fr«»tti ot»»* »» 91 k prr*<wj mav 1# wllJi' 

ihw ol»lttin'«l iiis<lr<r ilr wsfcpf ‘ife^ ^rr''«dl 

Imr Siwrvnf'^ 

Tht^ raV»)M-,i> r'i»miwwl tv< arl> !His*9 pjtijt}!*! m fi(9y4«w 

eUwsia 111 CJradP'* 11 VIII cl pHhJr WK Hir“!>'«il|t), ucdM 

Priaeipal FrwliiriPk r, (Iralmm Tlw nuraWi of r« n»rnl» fully ifnrw|»ldfl 
and uenblp in rttmpniini!: 8r<»r»* a# Whw*. 

FKfUl pwriod ■• 9 "f’Mw » 1 fMt fwif'fti 

Steusd j**ariwl <*5* <fHMawii w?ft 

Tol^ ttUfjjtMyf nif KtjnipW** (»'*(w4* i23<9 

For the (fqiiivalenl Ii;rc*up aitidw ttWcb m'Ci(»f(!j»j9jiii<»il ihe eUn)iM> 
lion of rticorda lo sccutti equivatcni mnpf^ ib'c loHal numlxpr of tflua* 
pletc pupi1*r«?coftl» vi-aa 2M}. 

PnnuMrNtARt ajio Fisai, Tiwiin* 

The Kune llsl of word# witjn u^fd for a pr'cllrmuoaijr aur| liiixl (("St 
The U»l coiwtiated of fitly wunls ehK^wn «i mnd^mi from »Vk word* l« te 
eludied by each el*ww durloK ih** 9*"** of »lm* r-sp-runK-oi Tb® 

te«l« were g^ven by ihe famiUnr colunm dicianon uioifiod Tin" nwni' 
Iwir of word* correct was nulltiplie^ii by two lo ronveni iho into 
percenlagoa correct . 

The IQ'b oblatnec! by gr(nt|M<*«iing itt ilw* r«»ni9W' work of the 
fichofl] Were Bocured from the webewd rrwirtU and ujfod in coiiipi^riDj; 
groups. That the Initial apelhng for ilw* eb»j«<Ji rotrs'Hjwin'l 

very clow'ly to the InteUiKcneo rating^ of the cWww »i » gtivm grade 
level is ftppan'nt In the data of Talde 1. It i« alwi ot»vtMua lUal. pnAc 
ably as n reaidi of frec|uen( examlnHUona wiili »he group iwi*. iltif 
IQ's, beginning with (irnde 111, mo high li m Isflirvi-cl, however, 
that tbc population of the school iia n whole is to ovrrnKe in 
ttttUve iiitcUcciunl cnpaciiy. 


l<F»flit*[.TS 

Cowpftrteon a/ Classes tritfim n ffirtra f/rode. Anw the pupd* in 
Utescihocil arc dafi®>d on the Imelaaf inidhgence teste, tt ««« Mii[MM«ftili|e 
to Beeuro groups of unitclected piiplls tviUiin n given grade A selieduV 
was therefore odopled which would give na nearly «s two 

equivalent combinnUons of claaaca within each grade. This w»« 
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The Jonnml of Bilafnititml 

usually doup by combining the bnghlMl and m om 

group and Ihc middlo cla<.3p<ii in lb<* oihcr Tlr pui mur-s wcip swsignal 
to Iho Sludy-tPflt plan and ihf* rtnddlo grouiw io nh** Te«tl~KUrdy pbm 
in one grade, Ihc revenw in the nM«t. and m* on nUomatfly, I>);‘fRulMi 
in some ol Vliie elftasra up^l ibo wbomi* nj w’rtcwn clartPi*. 

The records available for ll»e fir«<t exj^'rimeni ate aliown tn Table 
X. In Ibis table an* given for rarh gniup ihe nuinl-er of [nipiK Ibe 
mean IQ, the mean initial aiHling wwttt* in pt*rr<‘ntM«p eorrwl, Ibe 
mean final epcLling wsore, and the mean gain. The gain t** rttendy 
the dlfTerenco l>e, tween the mean initial and mean hrwl swrm, Tb« 
U«l line under each grade give** the nutnlfcr of piirdbn, the mean IQ, 
Initial and final scores, and gain for all the pupils of Uiai gr»de. Tlieie 
figures were obtained not from the prw*ding clas'Wwirv'^ bvtt from the 
individual records of the pupila in the grmipiie 

Slnoo a Bludy by Robert 8. Thompson* revralrtl wnon^ tliffieully 
In comparing gains of group® which differ in initml eeores, ibe daltt in 
Tablo I arc not readily interpreted when the iniitiU mirr'S are unequal. 
Dr, Thompson found that, other things Mng equal, pupils olitninjng 
a low Initial score gain more, in terra* of pereeniagiresof earned *r«*llinp, 
than those obtaining higher initial acoreo. He found that, in general, 
equal teaching and learning would produce equal ndeanrea in ibe 
Interval between the Initial iKTCcntnge correel and one hundml ji«f> 
contmto correct. Thus, ll one group mlvanwn. Bay, b«U of the dwiance 
from initial score forty pereenlage l« one'hundred iierceniage enrrwci 
or to seventy percentage correct, another Rroup with an (nliml wire 

of sixty should advance to 00 t- or 80 «« the result of injual 

learning. Wliilc these relailcms g^ven by Tliami«»n could !«• applied 
In this case, it was felt that where differetitwM are as small n*« Ihm* 
appear to he the more lalwrious procesB of sifting the ptqnb ilown to 
groups equivalent in initial mm*s would la* more ndiable. Table I 
is offered for those who wiah to make comparisons of claib.M>ft by ulibi!iug 
Thompson's data or other means. 

, C/emporfson of Qaino Made hy fjVowpa of Kquualeul /mliof Alnldy - 
Id Tablo 11 the results of both studies arc shown. In each enw pupil* 
were first arraiigod by grade*. Then pupil* fnllnwing the Kiudy-iesl 
plan were malchod In initial scores with pupil* fnllmving ihc Twl-Hludy 
plop, This usually resulted in a surplus of initial scores* in tine group 

* Thompson, It.: '‘Tim ElTiNiUTOneiHi of Modnra 8|)«l)inx In«lnit<ii<*in '' IVu'h. 
cr* CcUcge, Columbia Univoreity C^nlribiilionji lt» Educaiiou, N’« < 30 , 
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and low ??oarp» in the other, which had to Ik* climinntcrl. The plan 
pursued whs not an exact onc-iKT-one matching, but one which gave 
the largest number oi ciws without apprecmbly diaturblng the equiv- 
alence of the grouiM! in mean and .SI) of Initial pcores. Thus for 
example, one group might Ik* given thrr*p pupiln with scores of thJrly- 
nine, forty, forty-one resjwctively as equivalent to two score# of forty, 
when the ofTeetB of IhiH aRKignineiit could Ik* counlerhalnneed. ('on- 
scquontly, nlthough llie gmu]ut are aiilnttantiidly e(|uiv'aleiit, the 
numlwr of pupil# in llie group are wot nlwiiya the mime 

The rpsulla revealed by Table II may bcaummarixed by thoalatCH 
ment tlial in ao far ns chtTerencea are indicated at all, the Study-lost 
method produces larger gjiina in (irado II and low firndc III and the 
Teat-atudy plan yields greater gaiua from high Grade III to the Grade 
VIII inolusivc. 

The advantages of the Stiidy-toal plan in the second and lower third 
grades (t.e , first linlf of the third grade) are neither large nor, in terms 
of the .‘Itnndard lOrror, highly reliable. Since the groups arc eveniy 
matched in Initial apelling scores and since llio advantage m IQ’a, if 
any, in enjoyed by the TesUaludy groups, and aiiice the same teachers 
taught the groufra untler both plans, the consmloucy of the siipcriorily 
In gaina ahown by the Siudy-teHl inoiliod la indicative of a genuine, 
oven if arnall, dlffercuee. 'Phe average superiority of the Htudy-lcst 
plan in llie two grade levek liaaed on four hundred and aeventy-aoven 
pupil-records is 1.0.5, or a|iprnximalely two per cent. The ndvanlago 
is slightly higher (2.11) in the second grade and lower (1.30) in Grade 
III, Whether this amall advantage, nmiiniiig it to be genuine, is 
sufficient to dcmonHlrale superiority of Iho .Study-test plan in general 
In tlicBc* grades ih a topic for conaideration lai(‘r. 

Beginning with tlio second half <»r Grade III and continuing to Iho 
end of Grade VIII, tin* Tesl-aludy plan allows aliglilly greater gams. 
Aside from one amuli w'tback in Grade IV and uuolher in Grade VII, 
the Pre-test pclieine shows to tulvanlnge in all of the dozen compari- 
sons, Tile surplus in favor of lliis plan is conhisleiitly small and 
often lacks "aatisfiietory’’ .‘^latislieal reliability, Tlie ndvantagcH, 
beginning with the lowest grades are; 0 .53, 1,115, — (l.r?!), 2.00, 2 80, 1.01, 
2.84, 3.f)7, 1.70, -0 80, 0.4 1, 1. 1 1. The average of these figures, bused 
on 2*123 pupil-records, is l.^tO. The senes shows lui eoiiHiHtenl ih'vui- 
tion from tills average surplus in favor of the ToMt-sludy plim. 'I’lio 
plan, in other words, hcgiimiiig at llie nmldie of (inole III, seions to 
work m well, ndaiively, in the lower as in the uppei giiKh'#. 
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A.n iQ«p««Uoa ot Table* I iwigy^a »b«s pti^bUmy tb<“ HHuly- 
plum shofra to gr«?alo«l» advwni*^ {n eUw^ t4 dtjlirr pujrili', 
whereas tbe TeaNiludy meibod is tno«* toUiwI «« th*'* bnRh< 7‘flH« 
1X1 Is obtained by taking from each Krsid<» Incl tbr and Jbe 

dUUesfe elasM. I&ch cUw wa« laogbl by thi* rairo* te^aclw'r bri*i by 
otta method and then by the otlvorr 8in«w ibe joitwl 
jWficd of different words and g^wo at different 'Jitof, miiijal 

floorea were often different, To iweurK* group* ji’t orarly pjiuK-dcni 
as possible on the inlUsI lest worea th© rmird* w«'r(‘ rsfu^d »«* 

Tdblo ril show* that in Qradea II, HI, nneJ IV, i!i«* dull* ’‘i juipiU 
^Mde gtoator gnins wben langht by tbe hi t ii.ixii's 

y, VI, VII, and VHII they do os well when taught by the *iVfiii-*imb' 
method. The brightest oleswa on the whole mahe hirgyr grim* 
working by the Tesl-utudy plan, niere ere two plsiw’i, in (irad* li 
and Orade VI, In which Te«t>sbudy showa no ad\'ani»ge. “rite nvi’rsge 
snporiorlly of the method is 1 . 01 , a flgnn* aitghtly greater than 
tho average gain of L40 pereenUige for the eniin* fKi|rtilitnoii «d 
tbe sehool. 
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In Icrmis nf Ihp gftInR In nbllity In iho words after an interval 
of from one to ten weeka* after the words were atudic-d the reaulla 
show thcf Sludy-leal method to be ahghlly belter in the fiPcond and 
first half of Grade III, wherena llm T«il-«mdy method ia 8ii|>criar 
thereafter. In thn caw* of the dullest of the, four or five dnam at the 
high third and fourth grade leveln the Hludy-leat plan i« allghlly 
euperior, whereas in the ca«e of the bnglitrat of thm* gtoupa, the Tcat- 
Btudy plan t« equal to tsiiidy-leHt in the necxmd grade and alightly 
Buperior thereafter. Were no other faetors than ihefoo reaultii taken 
Into account, tlio n'commendnfion would bo to uae tbo pTt*>teHi plan for 
bright pupdn from the beginning, for average pupUa from the middlo 
of Grade III, and for the alovvoai pupila from the lieginnlng of Grade V 
and to line the Pn^-sludy method in the remaining claaoea. Since the 
advantage of either method is arnall in terms of specific spelling gains, 
It will be aeiisiblc Ui consider certain other factors. 

Let U8 oonaldor first certain limilnlions urged agalnul the Pre-lcat 
method in coinparlaon wdlh the Pre-study procedure. One freciuonlly 
mcalione,d limitation of lha Teat-study method lies in the fact that a 
single dlcluiitm leal is not a wholly relinhlo means of determining 
which words a child ean spell correctly. In the first place the test 
puls the child inin a slate of ennceiilrnlion mi spelling. A word which 
he might miiw|M‘ll in casual wniing or ovttn in a dictation exercise 
III which iilieiuion is partly devoKal to meaning or coinposilion, or 
both, may Ik* correctly spelleil when nlletilion is entirely devoted to 
spelling. Thus words iiisufrieiently mastered are oimlleil from study. 
In reply io this objection it may lie said, however, that the 'JVst-slucly 
plan providpH three tesis (on Monday, Wednesday, and Friday) and 
that words known wtII enougli to Ih* H|H‘lled eorreclly three, limes 
probnldy iieeii no furl her syslemulie drill 

It is urged Himiliirly that ehildran ivlio are not cerlain as to whicli 
of two or Ihtre nlleroiiliveM to iiw* will succeed frequently in gelling 
tho right form by elmiu'e Tims, Kilrer® found (liiil of words iniH- 
spelled in n second lesi, thirty-one per cent v\pre spelled eorrectly 
on the first leijl. Nearly a third of the woriis misspelled on the first 
teat apparently were not. perfeetly known and, it is urged by Home, 
should have been sliidied. In this coimeetimi (hr* plan of giving the 
pupils a brief preview of llie words, us by ri'atting them in printed 

1 Kiurn ili(* firml lr«L iiir1iiili‘il nii ei)iinl iiuiiitit'r uf wonts from •‘iieli of tlx* 
wwltlv li«li, It oeeinml nl inlervnh of ftoiii oiu* lo ten wei'Ks after the wooh wre 
aUiitietl, 

* .S'c/(Ofl/ «re<np. lOJO. pjt .VJI .'iW 
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OolUMQS OJ III conUsici, has befo bI la<f'h<*4, inA^*!^h w* H ^ S r w' 

the number of word* whlrH a pupd powjd *ip»5l nBJw-itS.siif'v W5*!^f‘ 
thorough maaicry. Tbo wri«*f, (u ft «b«iI! l<r*J f‘i frmf'? 

Ihftt twenly-one per cenl of tb<* worKl* !«prU<*d »fs«trrmh’ «**« * wr .a4 
test were corwcl on ibn fim wiilw^u^ «s?irr*'st? 0?* 

oentego wa« thirty iUut th*' chddwn ipv^n iw--* fuxurAf (cr# -str ,>4 
for B preview of Ibo ll«l. Kilw'* findina: nhsi 
of tho word* mfespeUed after an laicrvaj «f «wr« eriTj*'«'ilK 

8i>dllod In B lest Imraedlaidy ftflw a pmiew hw !’««■« I«5'<^'}w»3>rn3 
slmUarly. 

TheM would bo «lrong arptinMitiit Bipnr ibr «ii}df fof wwlt 
determined euUrcly by the «nglo Moailay i^w.. Tbo 
on Wednesday and Friday mem lo be osepllrnily axkpiii^d iif’i fj^Tw 
of tho condition* bore rcw&W. The plan wiww fsidy »»!} b,) 
the amoatti of study to the umb. With nire iPSi»p^i<rvM ihi** <mAt^ 

. mimd on iho first leal will be miwt pawriy bn^wj i«»4 
sumably most in need of the ipr»»U»l ammioi rrf Mady 
aUd theroaflet to ca* of a rejK^aied fRiUirr wn <fV^d« 

trariwlso, tho mere fact ilia t a child apclla a word c^mrity «» ikloiBthu « 
oven If ha falla lalor, Is evidence of a grsatef drisMV!* «»f 5*“,wft4s»|i 
If ho failed ontlroly. A word spelled coiwctly on Iwih 
'■^odnoBday is, wllh rare exception*, «tlll boiler fenowo- aM ^ 
spelled ootrCQtly on all throe duy* la probably koowti w «oII ft* 
should over bo taught through direct drill In the ^prlliiM W 

Bttoh a word is mlaspoUod she montba Inter, the r*splJWi»iK-'n pTHfbil'Iy 
, to bo found in the InUsrfcring lufluouco of word* «ub!M'qM«n 4 iJy 5r«K;'f4 
pr to lack of HOC outside of the spoiling lt»»na during ibe ptrsw'd J» 
the latter onso the roroedy la not more dnll but boiler ftflecijan «nd 
plaoemont of words. A word not «ml unUl <dx monito dfirr m %m 
been taught haa bbou iulroduciKl at baatsU moniha loo JwSr »«! 
of studying it more, Uic pupil* ahould «ol have aludiiid »J ai all al llwl 
time, 

With roforoiioo to iho maiiogomcni of the twty worKb tte? ii«. 
wotde already known well enough to Ik* *poUw:l corrrrity in r»rie mr 
more of tho throe teste'“tUc Test-study plan soerrw to ilw wriiK*r i« 
have all tho bettor of Uie urgiimont. It ia, in fiusi, nicely ctoffOt'd 
to wve tho pupil from needle;)* ovcrloaming of words bo «^n already 
Spell with aomo moosuro of coiudsteticy. The Uirco wilt rwely 
Mt a word slip through without praeilce if ll rwily nmk drill at iU 
tiime, No method enu oontrol «dl of tho exlgenelea of future ovcai#. 
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Concerning the treatment provided for the most poorly known 
li/nrda, the advantage of the Test-study plan is usually admitted. 
HMs plan shows on Monday, with rare exceptions, the words that a 
pupil is least able to spell from the whole week’s hst and enables a 
, pupil to concentrate on these ns much as needed up to the limit of 
the lull week. By saving time which the Study-tesb plan devotes 
to study of the easier words, this plan would scorn to enable the pupil 
ltd direct his study to the words most In need of It. 

At the same time the Teat-study plan tends to exaggerate to the 
illmlt tho elTccta of misplacement of wprds. The grade plnoemont 
i(jf words is far from a satisfactory condition, and in most schools 
many words arc doubilcos taught long befoto they are actually needed 
ilo writing. Such words Will mainly be dllBouIt words to spoil because 
'they have been used but seldom or never. The Test-study plan 
requires the pupil to devote a nmxumim amount of time in study of 
those words. Words which inll not be used for a long time will now 
either be forgotten before they are needed or ovcrloarned groatiy 
,'to maintain their life until they arc called for. In oithor case tho time 
Upont in drill is largely wasted. 

The Bludy-tcst plan, then, may lend to waste lime on tho study of 
"easy” words already known well enough or nearly well enough for 
eucceoslul usage, whereas the Test-stucly plan tends to waste timo 
upon study of "hard" words which ought not to be atudtod until 
later, ICvidcnce in support of this view may be found in Thompson’s 
study* of the enuaes of differences in the spelling difficulty of words. 
Tlio present writer believes that his results may best be interpreted 
ns indicating that "easy" wonls, on the whole, nro those most fre- 
qucnlly used in writing, and "hnrd" words those least frequently 
used prior to a given lest. 

With the liimlntion in grade placement now in effect, it is probable 
that one of these deficiencies is about ns bad as the other. Theo- 
retically, then, tlie contest may be called a draw up to this point. 

It should be pointed out, however, that the difficulty with the 
Test-sludy plan is not ns intrinsic and irromcdial as the limitation of 
tho Study-test method. Ueinovo improper grade placement, and 
this wnstefiilncBH of the TeHl-aliidy plan largely disappears. This will 
not be HO fully true of the Study-teat plan. Despite the probability 
that belter grade placement will leiut to produce daily or weekly 
lists of words of more uintorin difficulty, on tho average tho words 

Op, al 
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will still be of unequal difficulty to individuals in the oloas. It is 
precisely In the function of adjustment to individual differences in 
mastery of the various words m an assignment that the superiority 
of the Test-study method lies. The roost perfect grading system will 
scarcely make all children equally good apellors or a given child able 
to spell equally well (or poorly) all of the words in a given assignment. 
With a porfeot grading system, the Test-study plan would find a more 
arnplc defense than it does under present mediocre grade placement 
of spoiling words. 

Another defect attributed to the Pre-test plan more than tp the 
Pre-study plan is the loss of study upon Avords of nil degrees of difficulty 
duo to failure of the pupil or teacher, or both, to detect errors in the 
tost results. Kiizor pointed out the frequency of such errors when the 
pupils correct one another’s papers. They are likely to appear also 
when the teacher corrects the spelling. It may again bo said, however, 
that while errors are likely to go unnoticed occasionally in one lost, 
it is not very likely to bo missed three times in succession. The 
Test-study plan makes rather adequate provisions for catching such 
mistakes in time to give a word at least one clay of practice. The 
plan of having pupils correct tholr own spoiling by comparing their 
test papers witli the printed text has several features, moreover, of 
educational value. Apparently what is needed is to encourage the 
. pupil to develop a higher standard of accuracy in scoring liis spolhugs. 
Such a habit would be useful through life as an aid in the improvement 
of ability to spoil. 

Another objection offered to the Pre-tost is that it makes initial 
errors not only a necessary but a natural result. Binco tho spelling 
of the words is not always known, errors are Inevitable. Since tho 
making of errors is a necessary result — taken for granted—it seems 
also natural. Thus ill-effects are alleged to bo the issue. Tho first 
is the inculcating of an attitude of tolerance towaid mistakes in 
spelhng. Pupils are induced to look upon their mistakes with com- 
placency, The second ill-effect lies in the fact that tlio Pre-test force.s 
the pupil to " practice errors ” In this connection the alleged tendency 
of initial errors to persist is often emphasized, The Study-tost plan, 
on the other hand, by teaching before testing, tends to sot up standards 
of accuracy, to prevent initial errors, and to proven I tho practicing of 
errors. 

While the writer believes that tho importance of these tondoncics 
of the strict Pre-tost method has often boon overestimated, ho is 
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Inclined to boHcvo that they arc genuino and, in some measure, potent. 
To what extent the making of errors during the Pre-test tends to pro- 
duce a tolerance tor lni«apelUn(p^, if at all, is difficult to show, It la 
not imposBiblo, indeed, that testing, by revealing errors, tends to 
oultlvato an opposite inchuatiou to correct thorn and to develop a 
sensitivity to errors which ordinary writing docs not properly cultivate. 
The gonornl tendency for initial errors to persist is apparently far loss 
strong In spelling than in some other functions. Errors in spelling 
tend to be variable rather than constant. If a oluld cannot spell a 
word he most frequently spells the word phonetically. Most words 
may bo spoiled phonetically m almost innumerable woys, as Horn* 
and others have shown, and thej'^ arc spelled in many of these ways In 
repeated attempts by the same pupil. As Woody found, moreover,® 
the errors mode by children ni prchniinary tests do not tend appreciably 
to persist in their original form. 

Another consideration is the rclulicm of the two methods to the 
Interest and effort of the tenchor luul pupils. Keener’s finding that 
"the majority of teachers . . . were very markedly in favor of tho 
(Test-study) method" and that "they favored It because of tho greater 
interest on the part of the pupils . . , and opportunity of giving help 
where it was needed" is borne out in Public School 210. Although 
the Study-test plan was more of a novelty to the pupils, they favored 
the Test-study plan by nearly ton to one in a sample of votes taken. 

A problem of great importance is (hut of tlic amount of time 
consumed by tho two methods. Adherents of the Study-lost method 
point out thot relatively more classroom tiino is available for study 
when this method is used because leas time is spent in Icsllng, As 
commonly used, the Study-tost plan iciiuircs two tests per word per 
week, whereas the Test-study plan requires three weekly tests 

Adherents of the Test-study plan reply, however, that their plan 
requires less time in absolute terms — fewer pupil-ininules of work 
per week. Tho reason for this is that pupils arc not required to study 
all words, as in the Pre-study plan, but only those missed on a test. 
Thus, if a pupil iiussos no word.s on lhi> Monday lest ho is excused 
entirely from the Tuesday .study period. All of lliose successful on 
Wednesday aie excused from tlir 'i'liiiiHilsy peiiod, Keetier found in 
hiB study that about twelve pei cent \v<‘ve excused from lioth peuods. 

‘ A SourtjQ of (Joiifusimi iii .Spi'lliiia. Journul 0 / JiiUicdUo/ml Itckcnrch, Jnii., 
1029, pp. 47-30 

*Tho Evaluation of Two Molliixls of Tcnelniig Spelling. Year Uoak of the 
National Society of Colleyc Teachers of JUductUian, 1920 
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In the olaesos sampled in the prcBcnt study about ton per cent were 
excused from both periods and about eighteen per cent from tho second 
period. 

Tho saving of pupils’ efforts is by no means fully represented by 
the number of children who know how to spell nil of the words in a 
week’s assignment in advance of instruction. Nearly all of the pupils 
know some of tho words. In Table II the scores on the initial test 
represent tho average per cent of words to be taught during a ten- 
week period which are known in advance of study. Tlicsc represent 
tho percentago which they would not need to study under tho Pre- 
study plan. They are approximately as follows; Grade II, thirty-five 
per cont; Grade III, fifty-five per cent; Grade IV, sixty-five per cent; 
Grade V, sixty-nine per cont; Grade VI, seventy-one per cent; Grade 
VII, seventy-five per cont, and Grade VIII, sixty-eighf per cent. 
The average of these pcrocntagcB is 62.7. Thus the average pupil in 
his entire spelling oourso knows how to spell nearly two-thirds of the 
words in the spelling list a month or more* before ho is asked to study 
them. The Test-study plan requires three reviews of the two-thirds 
of the words a pupil knows — in the Monday, Wednesday, and Friday 
tests— and conserves all tho rest of the time for mastery of the ono- 
thlrd of tho words which he does not know. Theoretically, tlio Test- 
study plan is undoubtedly well oonooived to make tho most of tho 
pupil’s time. It should bo realized, moreover, that a test may be an 
effeotlvo means of learning. Indeed, In studies of memorizing nonsense 
Syllables and other materials a oombination in which a solf-tcst {like 
recall) predominates over mere reroading, proved to be markedly 
superior to mere review study.* 

From tho theoretical point of view, the surprising thing — to tho 
writer at least — is the fact that the Pre-test plan does not show to 
greater advantage than it does In this study and others. While it is 
neither a perfect nor a fool-proof plan, its disadvantages seem fewer 
and less serious than those of the Pre-study program. In the writer’s 
opinion most of the limitations of tho Pre-test plan previously men- 
tioned are not very serious onos, and most of these may bo removed. 
The most conspiouous deficiency of the plan, according to observations 
Of the writer and of others, is to bo found in weaknesses in tho pupil’s 

* Sihoo the lists used in llioso tests oovorod ten weeks of ndvnnco nssigninents, 
tho nvorogo would bo about flvo wooka. 

• Gates, A. I. ; Ilocitation as a Factor in Mcmoruing Archives of Paj/chology, 
1017. 
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method of study anti of inanagcincnt of his own work and the inade- 
quacy of the teacher's supervision of pupil's individual work The 
writer’s observations wore that in the Study-test plan the ’pupils 
wore held to the use of belter techniques of learning, to better distribu- 
tion of time oil diiferont words, In more adequate check-up of results. 
In the TesUstudy plan pupils were given less adequate guidance’ 
and often Buperviwon was superficial. As a result, pupils frequently 
dawdled or moro commonly uiiliimd poor methods of study failed 
to do their assignment properly, giving unduo time to certain words 
and insufBclenb tunc to otliors, failed to check their work properly 
and otherwise relaxed into inferior study. This was notably true of the 
least experienced and least intelligent pupils, who were precisely the 
ones among whom the method showed relatively the poorest results. 



THE NATURE OF INTELLIGENCE* 

J. II WILSON 
Introductoh^ 

In the discussion of the nature of "general intelligence” and of the 
possibility of testing it, an important suggestion has lately been made 
by Thorndike. lie had put forward a list of eight tests, based 
apparently on his own theory, and has implied that they will not 
satisfy the well-known criteria deduced by Spearman and his collabo- 
rators for demonstrating tho existence of "general intelligence” 
as a "central factor.” 

The issue is of much theoretical value and certainly seems impor- 
tant enough to justify putting it to the teat. A small research has 
therefore been planned \vilh this object in view, and the results arc 
described in tho following pages. 

The Conditions GovniiNiNa the Experiment 

Thorndike’s Hat of tests consists of tho following well-known 
processes; Memory for digits, pitch discriininatiou, opposites, defining 
words, completing sentences, arithinctical problems, number scries, 
and flomplcting pictures. 

Ho proposes that tests of this kind be given to 10,000 sixlcen- 
year-olds, the aoouraoy being sucli ns to secure reliability coelTicicnts 
of 05. Spearman aooepts tho tests, but adds that tlio subjects must 
'be of tho same sox, that they should have received reasonably similar 
education, and that all responses to one and the same lest must be 
uniformly marked by the some person. 

As put forward here the proposal is obviously beyond the power 
of any one invostigator. Spearman, suggests, however, a somewhal 
less rigorous procedure which makes it possible to test his prediction 
First he maintains that such high reliability ooeflicionta are not 
indispensable. Secondly he suggests that a number of independent 
workers might each examine about one hundred pupils. 

* Tills study has boon carriocl out uiutci tlio niiHpifri of llio llnglilon and IIovo 
Iliglior Ediieation Council. It coinpoHcti imrl of a tlicKW siibiiiiltpd for tlia I’li D. 
degroo of London Univaraity. Tlio nutlior w groally iiidolilod for vnlimblo 
aasistaiioo to Profrasor G, Hurt and also to tlio loaeliors and HliidoiiU who liplprd 
in tlio oxaTniiialion 
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Tni? Tbsth, SuDjEcn^ and Administration 

In carryiug oul the present inveRtigation, use was made of published 
material wherever po8«»hle. Thus memory for digits was tested as 
described in Whipple's "Mnnual of Mental and Physical Teals” 
under "auditory” and "viRunl” memory respectively, Pitch dis- 
crimination wa« readily measured by Seashore's apparatus and 
procedure. The verbal tests and the arithmetical ones gave more 
difficulty. Items were collected from published scales; but the best 
selection for pupils of sixteen years had to be discovered by special 
experiment. They were finally choRon after trial on the students 
of a training college for teachers. A lost of completing pictures was 
to hand in that used in the American Army tests, namely "A Day 
in the Life of a Schoolboy.” 

To avoid any Influence there may be in the day of examination 
the testa wore prepared in duplicate and given on two days, and to 
avoUl any conalaut factor entering the results tho clnlclvoii changed 
scats from time to lime throughout llie examination. 

Tho tests were given to Rome seventy-odd boys ranging in age 
from fifteen and one-half to sixteen and one-half, the average being 
exactly sixteen years and one motilli. Tlie boys wore taken from 
parallel classes of tlie same form of a grammar scliool, the form being 
the one preparing for tho f’leneral School <!ortificate ICxamination. 
In consequence of these liirnlalionR they formed a highly Rolcclcd group. 

Each lest was uniformly marked by the H.nue person. In certain 
oases this marking was done by Mi, as D. King of Brighton, m olliers 
by the writer, who takes lhi« oppoituiiily of (iitinkmg her for sucli 
valuable help. Sixty of the pupils had taken liotli examinations and 
their results were used 

Average Hcouks, Standaiid Deviations and Uemabiutiu.s 

Tliese values are given m Talile I. 

The first poml to be coiisideicd is llic value of each leliability 
coefficient. Tlie mujonly of the eoeflicienls lie between ..50 and 
.70. In comparison willi A)o, (lie iiguie Biigge.4lod by Thorndike, 
these results aie diHiqipoiuting. ('oiiRidering, however, how highly 
Bcicoted tlio group is in age and I'diieahonnl iillainmcnis, they coinparo 
favorably with those of other workeis m allied fields.* 

* WorkuiR willi ftUulenlH (if luiiverHilv itoik. Hii/Iclt olitniiicd vnliios winch 
ranged fiom .fiO down to ilO. 'I'lie writer wiUi yonuRPr laipilfl, using ccjuivulcnt 
testa from National A niul Terniiiii tSronp Tent of Mental Atniity, .37; fioin Olis 
and National A, 04, ivinl Teinmn njul Otis, .72 
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to tho degree that should be expocLod from the sampling "probable 
errora” involved. The quantity /i" is termed the "tetrad difference.” 

Ai>pi,rcA*rtoN OK Thebe CniTBuiA 

There are three hundred Bcventy-oight different values of F, 
Each of these values has been computed, and tho distribution of the 
results is shown in Table III. From this table it is roadily seen that 
many values differ from aero. And, at oiieo there arises the question 
whether such differences are significant 

To anfiwer this question the probable error of the quantity F must 
be known. This has been found by Spearman and Holzingor * 


T-uils 
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* Tho dulnlHiUon ha^ boon inndo m tins way to fucililnlo tho conBtmotion of 
Fig, L 'riiiK (jurvr i« llion hn miiininciiK 

To compare llio magnitude of each 'Hctrad dlfTcronco'' with 
its probable error, tho expedient has been adopted of dividing tho 
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The ilifTorenn* brUm'ii llu4 and llio Into value h mado up of two expressions 
involving llio fmirLb ordorn of tho Klumlnrd doviatioiiH of tho corrolatioii copflicients, 
Tlu^o ftro iioghgihfv hhiull o\<opl fm wiiiall values of the conclulion oi small 
iiurnborH of piipilfi and iiiav hr raloiilalod by iiumuih of the formula of Filon nml 
lVar«ou {Fhii Tnw, U^iynl Soc » I/mdoib A OXOl, p *202)» lloio» howovor, they 
are nogligibb' 

Kvon «o, till' forntula reiimiUH very ouiiiborrtomo and it has l)con oustonmry to 
\m miU rrrbuu TUw proeeduio will not bo followed hero 

hdcauso ono of the inaiii ildriniUics oxpni leiieed in the Ihooiy of two factois has 
hoon tho UHif of niibHUlutc entoria for tlio trno values. On tho contrary, tho full 
formula has bpon uagd 
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former by the latter These quotients are summarized in Table IV. 
In simple sampling a value for the quotient just exceeding 1.00 is 
,a8 likely to occur as not; a value just exceeding 2.00 is likely to occur 
about eighteen times in one hundred trials, a value just exceeding 3.00 
is likely to occur about one in twenty-three ; and for a value just exceed- 
ing four, one in one hundred forty-three trials. Until a quoticn t exceed 
four there can be no great confidence that it is likely to be “ signi ficant," 
A; value of five is usually required in statistical work, A value of 
three is, however, considered "suggestive." 

In Table IV twenty-two of the quotients are greater than three 
and one is greater than five. These large values constitute a small 
proportion of the total, and it is reasonable to ask whether they could 
be expected on the basis of sampling errors. 


P 
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To decide this question two expedients are available. 

In comphance with the first of these devices the values of the 
quotients have been distributed as is shown in Table V, Column 1 
. gives the range of the values of the quotients, while Column 2 gives 
the frequency of their occurrence In Column 4 the frequency which 
is to be expected, were the distribution normal, is given. Column 5 
gives the difference between Columns 2 and 4, and these differences 
are large, 

The probable errors of the differences in Column 6 arc readily 
calculated when the cases entering into the distribution arc independent 
observations, They are not independent in the case of " to trad differ- 
ences," for many of these contain the same I’^s, and the diffeicnfc r’s 
themselves have intercorrelated sampling errors. Values of probable 
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errors calculated on the assumption of the independence of the observa- 
tions will therefore be too small. They will give, however, a first 
approximation. Such values arc given in the third column of the table, 
and in tho Inst are to be found the quotients obtained by dividing 
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the value m Column 6 by that in Column 3. Examination of these 
values makes it highly probable that the distribution of the "tetrad 
differences" is not normal. 

Application of the second device supports this conclusion. By 
means of Table III tho histogram shown m Fig. 1 has been constructed 
In Spearman's "Mental Abilities of Man" (Appendix, p. xi) is given 
the proceduie that is to be followed in order to construct the normal 
curve to bo expected were tho differences due to sampling errors alone. 
This curve is shown in Fig. 1, and it is evident there are variations from 
what is to be expected by sampling errors. 

What, then, ie the cause of these perturbations? 

Before seeking the causes it is necessary to consider the question 
at issue To demonstrate the presence of a "central factor" the 
absence of "tetrad differences" in significant amounts was sought 
Their presence demonstrates that there is correlation over and beyond 
that due to the “central factor ” On the unifocal theory of Spearman 
this additional conclation, termed "specific correlation," can only 
be due to two or more of the mental performances here tested having 
in common tho same “specific" factor. 

Further, according to this view, such "group" factors (as they are 
called) have very iiariow incidence 

Two methods may be employed in studying this question. First 
those values of F which arc largo in comparison with their appiopriate 
probable errors may bo consideied. Examination of these “tetrad 
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differenceg” will help to indicate those tests which have “group 
factors," There are twenty-two values greater than three times the 
probable errors involved, and eighteen of these, including all greater 
than four times the probable error, may readily be accounted for by 
too large values of the coefficients ru, Tjh, Tss, run, and ro 7 . In particu- 
lar the coefficient of correlation between the memory tests occurs 



in four, those between the verbal tests in five, and that between the 
' arithmetical tests in nine, including the greatest value As but one of 
^ these values reaches the standard of five times the probable eiror, it 
' is impossible to do more than sny there is a suggestion of the presence 
I <5f a group factor among the verbal teats, slightly greater suggestion of 
one between the memory tests, and by far the most evidence in favor 
iof a group factor between the arithmetical tests. 

Recourse is now had to the second method, in which the amounts 
of “specific correlation" are computed. Such computation is effected 


The Nature of Intelligence 


27 


by Ui6 use of partial correlation * To apply the method to a given 
pair of tests necessitates finding the correlation of each test with the 
central factor. The most reliable way of obtaining each of these two 
coefBcients is to use nil available pairs of tosta, but all coeffleionts of 
correlation introduced must obey the tetrad equation,! Hence in 
obtaining the ooefRoients of correlation of each test with the central 
factor! (see Table VI) no use has been made of the coefficients for the 
memory tests, nor of those for Iho arilhmelioal ones, nor of those for 
the verbal ones. The values, It will be noticed, are in the mam 
small, the third test (opposites) being the only exception. 

Tablb VI — CoEPsiciENTs OP Satuiiation 
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The coefficients of correlation between the specific factors are 
, suminarized in Table VII. In the same table are to be found the 
quotients obtained by dividing each coefficient by its appropriate 
probable error. There are few large values for these quotients, 
Values greater than three occur in the case of the two memory tests, 
also in the case of defining words and the visual memory tests, again 
in that of supplying words and opposites tests. In that of arithmetical 
problems and opposilcs and finally in llic case of tlie two arithmetical 

* Write Tat for the coi relation between two teats a nnd b nnd rga, Sb for the 
corieintion between the factor spcuiflc to a nnd that specific to b, and there ensues 
by the formula of Ynlo toi pailinl conclation, the equation 

^ fa b ^ fgglf b f 

Vi — Vi - rhg 

w^oro g denotes tho factor common to both a an<l h. For tho correlation between 
the spool fio factoia will ho that found when g is held constant TUeao values have 
boon found for nil tho possiblo pane of te^ita uacd, 
t Lot Tag bo tho cooflioiont loquncd, then 

j fobi ~\r * ‘h ratfay Hr * 

I ^ ru -f- fftj + * * + f*v 'b * * 

a, b, c, oto,, bomg tho tests 

t Those coofRcionta aio technically Loimed ‘^satuiation cocfficienta ” 
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testa. The only stEnificant value is that olitnincd for Ihc two arith- 
metical tests. 

A further investigation may now bo attempted Tetrad difTcrenccs 
may ho selected in the following way: 


TaDLB VII — COBFFlClBN're OP ComiKBATtOM IVLTWBBN .Sl'Wirie l'\( roKH 
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Take any four tests, including only one at a time from llio verbal 
tests, one only from the arjtlimclicnl teste, and one only of the memory 
teats. The coefneionts are dctci mined solely by ft "central fnctor," 
and the tetrad equation ought to be salisfiod to the degree to bo 
expected from the sampling errors. 


Table VIII — ^'I’etkad DiPFEitENoEs PnBDiCTBD a.s SATiHi<’\i.s’n C:itn'BitiA 

(N = 120 ) 
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1 TKo difiti’ibutiou UaB 

been mndo lu \\m way to fuciblnto ih\i 


Pjg. 2. This curve thus beeomos syinmolncnl. 


This may bo done by oonatnicting a series of tablo.s siinilftr to 
Table II, in each of which is placed ii selection of four of the tests. 
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In thjs way forty such tables may bo conBtruclcd^ and from each table 
tliero will onauD three valuea of the qunnlily F, making a grand total 
of one hundred twenty. These vnlucjj aic distributed in Table VIII 


1*AI*LK JX' (^ITOTIBNTrt ^ pg HF F 


QitJoriuvr 

FniiqtlKNCV 

From 0 to 1 

. 47 

Greater thnri 1 iiji lo 'J, 

40 

OrcaUir tlmii 'J up (n 3 

22 

Orcfitflr tlian 3 ufi lo 4 

2 

Oiffttcr lliftu 4 up to cf 

0 



in a form amiable for flio formallou of iUo luatograin given in. Fig 2. 
In the Hiunc figuro ia diiiwn the noriniil curve to be expected were the 
dilTcroncos duo to Hainphng citoih. Table IX and Table X have boon 
modeled on linos aiinilar to those employed in Table IV and Table V 
respcotivoly. 


32 


The Join ml of Educalionul rsyehologij 


I'AHtB XllI, — SVhWFiC CounmAllONH 
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and opposites. The values arc only "suggeslive," uiul among .so 
many values (fchirty-six m the fust experiment niul l wcnty-i'iglit in the 
second) can most rcosonalily bo iiccounlcd for liy smnpling errors 
It is interesting to note, however, that specific coirclallon litui lieeii 
mamfcslcd for boys and not for girls in at least one experiment,* 
though it must be added that in it the tesla involved difTeront menial 

ptOCCSSGS 


SuMMAin' OF TlIB llUBUI/ro 

1. The results obtained with the teals used cnii rmidily be explained 
on the basis of a “central factor” running througli all (he pm fm mnnees 
and a number of other factors spccifio to each pcrfornuiiici*, provided 
that the two specific factors bolonguig lespeclivcly to the, undimeltcal 
tests overlap, 

2. Thcic is, then, conclusive evidence of a '‘gioiip” fnclor in the 
arithmetical tests, and this ie.sult agrees with ihobii of Hogers** and 
Coilar. Such group factors aro of gioat iinportaiice bolli l beorol leally 
and practically They are tacitly assumed m nil work on “Hpecial 
abilities” suoli as “practical ability,” “musical alnlity,” and the like, 
The demonstration of their presence has been made in but few ca'-es 
The reasons for lliis Jack of expeinncntal evidence are lunvlieic moic 
succinctly put than by Piofossor C. Burt.’ lie wules, “ Over specific 
inborn abilities I need not lingor. Por them effective tests have pioved 
disconcertingly hard to contrive. Simple cortelalimi in hmo inuppli' 
cable General intelligence la always getting m llm way. We (IniiK 
we have tested eomothing specific. We find we have only hit upon 
another tost of lulolligonco. Its ubuiuitoiis iiifliiimce eun niily be 
eliminated by some claboiato tcohnical device, the iirocedure, for 
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example, known rnuhii)lo cnrrflnlinn; and the eojjiplcMly of the 
whole (ask bewihh'rs wlH‘re il nnl Inifflo,* 

Xur (lo nic**'* ‘»p*i ^ fjPluMmli iirrHunijililv uilinni. diTkre tlirniHrlvrH 

nt ‘HJ nil nK<^ Hi*' gMo rnl ^^jHs iali^fihon ihinn^ llir firnl twelve 
ycnrrt of ehiMliofid Vi tle^ ratloT than llir* nih* . (lie child 

coMlninH hi fn^wh arid rlorni'iiO • Hio rcmh of cverv /aniltv alniu' 

bt:trft>rt niir idiO'<> ricnnn ,i AihiJi^iMiie in jir<i«niipicrith Ihe period when innny 
of thc'*^c )opnli?cil Inh'iiK and r^\Hu i d mP'rr kIh m»*ciii for (lii* lirat lime lo inaluro. 
AccoTiltugly, rjforh ui guul^urr fttvl rdiini/Hooif Bpfrmhzutwji uiust 7wl 

hejorcfd /d Im torip a Wo-gfe i U/iln i tome J A I priwMit, f<ir example, Llie nyatein 
of junior eoiinU Hcliolaidoj^u leiiiln lo ^wn-p nil #jur hriKhtest rliiUlren at the ago 
of ten or clcMui into oiidnrx IohiN of u \\ hal rtradeinm Lyj)o< \Vheii at a 
ialer iieiiud eNninnoilunw an* In hi for Itode eehoid^, inowl of ti\e iiest insVanePB of 
BpermI Ifilcnl are iiim^iiim; (Ion liii\o a1n*;id\ hren r* reamed off and ilrafted into 
Ollier direct cpiih h oipnl In llo ir |KPuer>‘ 

Ainojif^ Uh* eaM»« wlifn* fuelnrs do hccoino of appreciable 

magnitude ihi^ five ntosi iin|pfijiiuu have been in wpect of wlmt may 
be callod llu* In^ivih (hi» nieelmineuh (Ik* psyehc)lop;ical, the anlli- 
inclical, and llm inuMeal abililie^ fu each of llieso a group factor 
has been diseoviueil of Milbejent breiultli and degieo Lo posacaa wciious 
pmolical coimet{uen<*es raliicalional^ indusiiiali and vocational. 

3. (ironp fmdoiH me evirlendy alwnl evtm wluuc they miglit 
ollierwine Imvc* lieeu e\pc*eliMb 'rhere is, for ojfample, no demon- 
atrnled group fiielor in die verbal tents nor one in the memory tcpfcs. 

Particularly evident is ibe lack of a guuip factor botwooii Iho 
oppovdt^s h‘sf and dial of tlelinuiK words, for both tests appear to 
depend largely upon uiulnsfmidiiig di(‘ meaning of words. Yet in 
neither of the l\so expenineuts ih there any approciablo spooific 
corrdalion. Ybe amount of eonelalion between Ibo specific factors 
in the iiieinory U‘sls is Ingb but not significant A .similarly high valuo 
wasohtaiiHsI hy f'aiey, in wineli (lase iL was Hignificaiit 

d, The luvi'hMgation ’>eiV(s lo tluow bglit upon a con.stilucnfc of 
the specific fact 018 of an ol>vious kind and yet not unlikely to possess 
groat imporlanee It i^oUvSi^nls in the niaiiner of piesentation of the 
task to du‘ pu|uls In tb(‘ eaie of du* vmbal and iiiithinetical tests 
(lie preM(»n(ulinn wum nmdi' by writing Tlie presontfitioii was oral 
in the ca^iMd die lesis nf “mnblory nuunory*' and pilch diHcmamation 
ftud was I mill vimial ami <uul in dinse of ** visual memory and picture 
coiiipkdiou/^ M*lie evidence denved fioin Lius invcstigalnoii would 

* \\(jrdh \Vi le will ten lu fnie tlu‘ jiuhlicalioii of tiu' jiiobablo eiror of tho 

'‘tplrnil <liaH(‘ii(*p< ■’ 



34 


The Journal of Edimlioml Psychology 


point to there being no Bpecific correlation in the mode of presentation. 
The choice between oral and written tests, then, would seem to intro- 
duce no group factor of appreciable magnitude. 

6. The “coefficients of saturation” differ for the different tests 
and also in the two experiments. For the boys, pitch discrimination 
contains but very little of the “central factor,” while the amount 
for girls IS appreciably higher. A similarly well-marked difference 
occurs in the opposites test, in the supplying woids test, and in the 
number senes test As to the test which gives the best measure of the 
“central factor,” this obviously is the opposites test m the case of 
the boys and the supplying words test in the cose of the girls. 

6 To be effective m the evaluation of amount of the “central 
factor” present in any particular testee’s performance, a coefficient 
of satuiation in the neighborhood of ,995 Is needed. None of the tests 
used in this investigation even approaches this perfection. 

BiBUoanAPHY 

1, Vide Psvchologteal Review, 1922, Journal of Educational Psgchology, Vol, XV, 
1024, pp, 194, 303, tbul , Vol. XVI, 1026, p. 423. 

2 Maofarlane: Bnlisk Journal Psychology, 1025., Mon, Supp , Vol, XIV 

Rogers and Collar Columbia UmversUy, CotilnbuHons to Education, No 130, 
1023, 

3. Burk: ''ProBulcnlittl Address to British Association for Advancement of 
Sciences, 1023 ” 



ON PARTIAL COllRELATION VS. PARTIAL 
REGRESSION FOR OBTAINING THE 
MULTIPLE REGRESSION EQUATIONS 

UAllOLD D. GllIFFIN 
Enrplca iSpniiKKi Arknnsn? 

The Requeswon Jl'’iQT}ATiON in Eoticationae Psycholoqy 

In tho physical sciojices, where exact experimental oonditiona are 
.comparatively easy to maintain, it is possible to predict with con- 
siderable confidence tho effect of a given set of causes under hke 
conditions In cducnlionnl psychology, ns well as m many other 
fields, we are unable to isolate factors witli such ease. It has therefore 
been noccssary to develop a technique by which one may draw from 
a mass of data, often conflietiug, some conclueion which will represent 
the most probable relation between variables. This la the correlation 
technique. 

Correlating two variables, however, is but tho beginning of serious 
study. Tho educational psychologist seeks means of prediction and 
eontiol For example, no sooner weic wo measuring intolhgence 
than we wore correlating intelligenco with school marks, obtaining 
regression coefficients, and attempting to forecast school success. 
But as intelligence teats correlate only from O.-IO to 0,06 ^ or so with 
school marks, oducntois began to iiso the multiple regression procedures 
to improve their predictions. Thus, May* sought a bettor prediction 
of college success by inclnding time spent in study as n third variable. 
This pioduccd a multiple correlation coefficient (Fo tj) of 0.824, 
which was considerably better than the simple correlation (roi) 
of Intelligence and college success, ivluch was 0.60 

Difi^iculties in Present Procbdure8 

Multiple regression equations might be employed to a much greater 
extent were it not for the difficulties, both real and fancied, of the 

‘ A coriolfttion cooilicioiit of 0 40 lins but eight per cent foiocnatmg olTicioncy, n-nd 
ono of 0 05 hna but twonty-fivo iioi coni .Seu Hull, C. L : Tho Coiiclatioti CoofH- 
oient Mid Its Fioguoalic Kigmlieaiicc. /ouriial 0 / lidwaiional Rematch, Vol XV, 
1927, pp, 327-338; also Wallace aa<l Hnctlccor; “(Correlation and Maoluno Cnlouln- 
tioQ,” Official Pubhcfttion, Vol. XXIlI, No 35, Iowa State College of Agiioul- 
lure, 1926, p 17. 

‘May, M. A.. Predietiiig Acadcinio Success. Journal 0 / Educalioml Psy- 
chology, Vol XrV, 1923, pp. 420-440 
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procedures now in vogue There are bwo general methods of obtaining 
the multiple regression equation, both seeming to havo originated 
with Yule. One is the partial correlation method, the other is the 
partial regression method, The former is at best tedious and inade- 
quately checked but, given time and patieuco, by it one can handle 
almost any numbei of variables. The latter solves by means of simul- 
taneous linear equations, but the technique that commonly has been 
employed, determinants, is very difficult to handle with more than 
four variables Foi a thiee or four vaiiablo problem, the partial 
regression method with any type of solution is much swifter than 
paitial correlation methods. Foitunatoly, there aie methods for 
solving simultaneous linear equations that are superior to determinants 
and are capable of handling efficiently any number of variables 
One such method, the Doolittle, has long been used by the United 
States Coast and Geodetic Survey and by some civil engineers. The 
purpose of the present paper is to bring this method to the attention 
of a larger circle of educational psychologists than at piesont employ it. 

HisTORiOAii Development 

The possibilities for preditftion in the regression equation have been 
known only to the present generation, and the very concepts of 
correlation and regression are not much older. An historical survey 
of the development of these concepts may reveal why procedures in 
obtaining the multiple regression equation and also efficient methods 
for solution in intermediary steps still lack standardization. 

Bhavais and His Reputed Discoveiues 

August Bravais, a French geologist and mathematician, was once 
given credit by Pearson ior devising (between the years 1838 and 1S46) 
formulas for solving correlation and intercorrelation between two and 
three variables.^ But earlier ideas with regard to Biavais’s place 
in the history of correlation have undeigone modification. Pearson 
himself now holds that Bravais, while working with two and thieo 
variables m geodetic work, developed relationships between his piod- 
uct-sums and Gauss's mean-errors (our standard deviations) which, 
had these relationships been developed, would have led to symbols 

’ k . S\w les PiohnUhlts tit’s Euouis tic 

Situation d’un Point, Memoites Acaddmtques de la Itoyale Smcnlifiquc Ijishlule dc 
France, Science, Maihhnahque el Physique, Vol. IX, 1840, pp 265-332, 

Pearson, K Begrcssion, Heredity, and Panmixia Phil, Trans, of the Royal 
Sociely See A. , 187, 1896i pp. 263-318. (See especially pp, 261, 287 ) 
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equivalent to our correlation coefficient. It is doubtful, however, 
whether Bravnia was even thinking of corrclalions between his observed 
quantities.' 

Galton and tub Concept "r” 

During the tnldclle of the 1870 ‘b, l^'rancis Galton was seeking a 
numerical mensuro for “revpision.” At a lecture delivered at the 
Royal Institution of Groat Britain, February 9, 1877, ho presented 
a symbol for stioh a measure, and symbolized it “r.” Furthermore, 
ho presented it in an oquaticm, c^i = aV(l ~ >’“)) which, of course, 
may be written r = \/I — uVc^i. In these formulas, v = the 
variability of a family of sweet peas, and ci = the variability of the 
general population of swcot peas That Galton was clear in his 
mathematical rcaboning may bo seen by comparing this formu la wit h 
Mill’s formula for the measure of correlation, r = \/l — 
or with the correlation lalio in its original form, = \/l ~ 

Galton’s Icotuio was published m Nature, Vol. XV, for 1877, whore it 
may bo oonsullcd ® 

About ten yeais later Galton developed an empirical method for 
determining the correlation between two vnriable.s. Ho made a 
distribution chart and dicw a line across it in such a way as to touch 
as near the mean of as many rows as possible Ho then measured 
the angle of the deviation of this line of best fit from the vertical. 
The tangent of this angle gave him Ins mclox of reversion, or "regres- 
sion” as he was now terming it. Tangents were used because they 
swing from +1.00 through 0 to —1.00, thus forming a very convenient 
measure of varying degrees of deviation fiom perfect positive to perfect 
negative. For some time tins r was called Galton’s function, due to 
the use of this term by Weldon who applied correlation in his measure- 
ment of vaiious sea life,' 

' Pearson, K. • Notes on tUc Ilisloiy of CJoirelation Biometrikn, Vol. XIII, 
1920, pp 26-46 (Sco especially pp 28-32 ) 

Darmois, G • " Slalislique Maihimahgue,” fiist edition Octave Doin, Pans, 
1928 Seep 24C1T 

* Mills, F. G.. "Statietical Metliods Applied to Economics and Biisincss,” first 
edition Heniy Holt nntl Go , 1024, iip 437, 442, 

* Galton, P : Typical Laws of Iloiedity, Nature, Vol. XV, 1877, pp 492-406, 
612-614, 632-633 (Seo especially pp, 632-633.) 

‘Woldon, W. F. R. Ccilain Con elated Vanatioiis in Ciniigoii Vulgaris 
Proceedings of the Royal Soctely, Vol LI, 1802, pp 2-21 

Weldon, W. F. II, On Ceitain Conelatctl Vniiations in Carcinna Mocnas 

Proceedings o/ the Royal Society, Vol. LTV, 1893, pp 318-320, 
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Edgewouts and the Teum "Coefficient op Coihielation'^ 

F. Y. Edgeworth (1892) dealt with Gallon's funotion for fchreo 
variables, and indicated how the method might bo applied up to six 
variables, making the assumption of normal distribution. He used 
tho phrasG "coefficient of correlation'' instead of rovorsion, rGgression, 
or Gallon's function, and the term persiated.^ 

Peanson and the Product-moment r 

By 1890 Pearson (Footnoto Ij p, 30) had introduced the product-sum 
method, enabling the coefficient of correlation to bo calculated withour 
the use of an isopleth or thread. Since then wo commonly speak of the 
Pearson product-moment 7. Many interesting variations of tho 
Pearson product-moment formula liave arisen since Us first statement. 
Symonds has listed some fifty or more variants,^ 

Yule's Two Methods in Multiple Correlation 

Pariial Begresmn Melhod, — G, U. Yulo, then an assistant of 
Pearson, gave a discussion of the product-sum methods in their 
applications to correlation in two papers published during 1897.® 
In his paper on the theory of correlation Yulo obtained partial regres- 
sion coefficients in a three variable problem by solving an observation 
equation sot up by the method of least squares, using determinants, 
Merrlman, whose "Textbook on Method of Least Squares"* (sixth 
edition) Yule used for setting up his equation, suggests tho Gauss 
direot method of solution (the basis of the Doolittle method) on pages 
61^06 of the edition used by Yule, but tho hold of the determinant 
method of solution seems so strong on British mathematicians that 
neither Yule nor hia immediate followers profited by Morriman's 
suggestions We thus find that our newly lovivod partial regression 
method was really the earlier method for obtaining relations between 

^Edgeworth, F. On Con cla ted Avci ages Philosophical MagaztnCfl^iith. 
Series. Vol XXXIV, 1892, pp 190-204 

® Syiuonds, P M, Vauationa of tho Product- Moment (Penrson^s) Cocfficiout 
of Correlation, /oiirnal of Jiiducalional Psychologj/j Vol XVII, 1020, pp. 4C8-409. 

*Y\jlo, G, U/ On tho Signiftcanoo of Biavais' Pormulao tor Uegrcasion, Eto,, 
in the Case of Skew Correlation. Proceedings of the Royal Society ^ Vol. LX, 1807, 
pp, 477-480. 

Yule, G V.: On bho Thcoiy ol Corrolafcioii, Journal of the Royal SlaMical 
Society^ Vo). LX, 1807, pp 812-854. 

* Merrunnn, M.; **Toxtbook on Method of Least Squmos." Now York: Jolm 
Wiley and Sons, (Many editions, tho eighth la of 1911.) 



Partial CorrekUi&n t>8. Partial Jteffrem'on 30 

three or moro variables. Falluro to approcialo Uio uso that could 
ibe mode of the copfhcicnl of inulUplo correlation proventod the 
devolopmont of the partial regro^ion method for aorao years. Aa 
ilhteaa 1000 Yulo could write,' "No practical ueo has, we boUove, been 
imado of (the coefGciont of multiple correlation! . . . but it appears 
Ho have coaBiderablc importance, and may bo Indioativo of the olosonesa 
()f the causal conDcclion between one variable and the joint influonco of 
two other variables of which the first is a funcliou.’’ 

Porttaf Cerre/ution Method . — It was this pursuit of causal oonnoo- 
tloas that diverted the partial regression inolbod. Yulo had been 
attraolod to the possibilities in partial correlation for detormlning 
causal relationsliipa. Consequently ho developed a method for 
solving partial r'a that leads indirectly toward the ooeffioient of multi» 
pie correlation, but is verj'^ laborious. As yot ho had neither named 
nor syrabolisod the regression cocfllciont. Yulo was a careful Lnvesbi-< 
gator and a painalaliing reporter; tboroforo his writings carried the 
weight of authority, and the methods and terminology that ho preferred 
beoamo the aocoplod standards for other Blatlstioal workers. In 1007 
Yule presented the system of notaUon substantially as used today,* 

It was at this tlmo that b was introduced ns the symbol for the regres- 
sion ooeffioient, and that a system of aubsorlpts was developed tp 
represent depeudeub and indopendont variables. Yulo first published 
his "Introduction to the Theory of Statistics"* In 1910-1911. This 
Jbook has been exceedingly popular and has run into many oditions. 
It has served to oodlfy Yulo's methods and bcohniquos, so that statlsti- 
olans who have boon intcroalcd primarily In obtaining regression 
equations, yot only incidentally in partial correlation, have patiently 
devolopod thoir oquatlona by his partial correlation technique.' 

Systematizinq Paktial CoRREnATioN Methods 

Truman L, Kolloy systematizod Yule’s partial correlation procedure 
in 1914 BO that one needed to find, for example, but sovonty-eight 

'Hooker, It. n. Olid Yulo, (I 'U. Nolo on Estiinnlmg the Rclativo Influenoo of 
Two Vnrinbica upon a Third. Journal of the Royal Slalmlical Society, Vol. LXIX, 

1000, Dp. lor-200. 

'Yulo, 0. U.: On llio ThoorY of Corrolalion for Any Nuinbor of Vnmblos 
Treated by a Now ByoUnu of Nolntion , Proceotlinos of Iho Royal Society (Senes A) 
Vol. LXXIX, 1007, p|). 182-193. 

'Yulo, Q. U.: "Inlroduotion to tho Theory of Stntiatios,” sovonth edition, 
reviaod. ClmrloB Griffin and Co., I^endon, 1024. 

'YuIoJfWd., pp. 226-2-18. 
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partial r^s and one multiple r in a six-variable problem if one were 
seeking the regression equakon ^ Yule's complete method would 
require two hundred forty partial r's for a six-variable problem. 
In 1917 Curt Rosenow made a further analysis,^ reducing the number 
of partial r's to forty-five m a six-variablc problem, but requiring four 
incidental multiple r's in the process* C. L, Huffaker's schema® 
requires forty-six partial bub only two multiples— one of these merely 
serves aa a check on the other. The schema for three-, four-, and five- 
variable problems employed by Henry Garrett'* resembles Iluffakcr'a. 
J, E, Bathurst has extended Huffaker’s schema to include seven and 
eight variables ® Yule's complete method requires three hundred 
fifteen partials for a seven-variable problem, and five hundred eighty- 
eight for an eight-variable, Bathurst requires eighty-three and one 
hundred twenty-nine respectively. In 1916 Kelley contributed a 
cleverly worked out set of tables to assist m solving partial correla- 
tions,® The first edition of this was soon exhausted, however, and, 
for various reasons, it has never been reissued. 

Retubn to Partial REanEssioN Methods 

In the herculean task of gathering the data and publishing Iho 
results of the Army payoliologlcal examinations a more direct 
method was required for finding the regression equations Brown and 
May, at the suggestion of Karl Pearson and Raymond Pearl, used 
simultaneous linear equations with solution by determinants,’ as 
Yule had done nearly a quarter century earlier, Kelley then turned 
his attention to methods for shortening the determinant solution of 
the simultaneous linear equations. In 1921 he publiehcd a nomo- 

1 Kelley, T, L; "Educational Guidance/' (fiist edition), Teachers College, 
Columbia University Contributions to Education, No. 71, 1014 

* Rosenow, G : "The Analysis of Mental Fimctions/' Pfiychologicnl Mono- 
graphs, Vol XXIV, No, 6, 1917 

^HufTakcr, C L. A Contribution to the Technique of Paitial Coriclation. 
Journal of Applied Psychology ^ Vol VIX, 1023, pp. 135'142 

* Garrett, H* E , "Statistics in Peycliologv and Education," first edition. 
Longmans, Giecn and Co.^ 1926, pp, 223^231, 240^261 

®Bathuiafc, J, E : A Partial Coirolation Schema. Journal of Applied Psy- 
chology, Vol, XI, 1027, pp. 166-104. 

* Kelley, T. L,; Tables: "To Eaoilitato the Calculation of Partial CoolRciciiU of 
Correlation and Rogi ession Equations." Btdlelin No. 27, Univeisily of Texas, 1010 

’ Ycrlces, R. M.: "Psychological Examining in the United Stales Auny." 
Memoirs of the National Academy of Sciences, Vol XV, Govoininoiit Punting 
Office, 1021 
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gram,* for faoiUltiUng compulation of the parliol regreaslon coeffl- 
oientfl. That «anip year Clark L Hull publisliecl a description of a 
nomographic method for solving pariial correlations,* but his alinomont 
board was siiggeatcd by the parliol correlation technique and XColley’a 
"Tables" of 1910 rather than by the partial regresaion method. In 
1023 E. R. Wood prepared nomograms for solving the formulas 
for partial correlatton coeflicienlB and the formulas for partial regres- 
sion cociHcIcnta. Wood's charts consUtulc by far the best graphic 
solutions for thciK' two fonnnlna yet proposed, but unfortunately they 
have not yet been published commercially.* Symonds, following 
Kelley, made a job-analysis of determinant solutions in throe- and 
four-variable problems, and published charts based on this method.* 
But solution by dotonninants proves troublesome beyond four 
variables.* 

^Kolloy, T, L “C’liarl to Fncililiilo the Calcination of Partial CoofTIcionU of 
Correlation and Eriuationn/’ Unit edition. School of Education, 

Special Monograph, No 1, Stanford Uinvcraity Publicationa, 1921 

Kelley, T L \ ” Alignment Chart of Correlation Functions.'^ Stanford Uni- 
versity Puhlicationn, 1021 

Sco also, Kplh% T. L : "Statiatical Method/' first od. The Macmillan Co., 
1928, pp 201-'205 and inflido liark cover, 

*Hull, C. L : A Device for Dolerinining CoofBcicnla of Partial Correlation, 
Psychological Ucckw, Vol. XXVIll, 1021, pp, 377-383. 

*Wood, E. ll.; '*A Chart for Obtaining Partial Correlations and Hegroaaion 
Equations ot Thrca or Moro Variable#," To bn iwnied by tho University of 
Chicago Press. 

^Symonds, P, M : Job-analysia 8hoct for Computing Partial and Multiple 
Cooffioionls of Correlation and llcgresaion Coofiicients. Tcachera College Uecord, 
Vol, XXVn, 1026, pp. 62-00. 

Symonds, P. NX.; "Partial aiul Multiple Correlation Chart. Throo Vari- 
ables." Toacliora CVillogc, Columbia Univoreity, Bureau of Publications. 

Symonds, P. Af/ "Partial and Multiplo Cbncfation Chart Four Van'nhfos " 
Kot now listed for aalo. 

* For methods of HoUUion by dclcriniriants see, Whittaker, E, M and Robinson, 
C,: "Tho Calculus of Obsorvations," second edition. Blackio and Son, London, 
1920, pp. 71-77, 231-234, Tho first roforcnco is to Ohio’s method of solution 

Doming, JI (f : A Syatomatic Method for the Solution of SumillnncouB 
linear Equations, Amcncati Mathematical Monthly ^ Vol XXXV, 1028, pj) 300- 
803. An orderly application of Ohio's method. 

Hanus, P, II,' "Elomentary Troatlao on Tho Thcoiy of DetcmniimnlSj" first 
edition. Gmn and Co,, 1880. Largely follows the inothods and praotico of Muir, 

Salmon, G.; "Lessons Introductory to tho Modern Higher Algebra," fouifch 
edition. IIodgoH, Figgis and Co., Dublin, 1886. Fourth edition icpiint, G E, 
Stechert, Now York, 1024. A thorough introduction to determinants foiioivrng 
tho metliocls and piacticee of A. Cayfey and J. J. Sylvester, 
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Itphation Metuops oe Sopction 

There arc, however, other ways by which simultancoua linear equa- 
tions may be solved, Carr* lists some six or seven direct algebraic 
methods, There are also certain indirect methods of reaching the 
results by iteration, or successive approximations.® llccenlly, 
Kelley and Salisbury have advanced another such method® which 
they claim will reduce the labor of computation in a sixteen-variable 
problem at least niuoty-fivc per cent over determinant methods. 
Tolley and lilaokicl have shown, liowever, lliat tlio Kelloy-Sahsbury 
iteration method in Solving a six-varinble problem for partial regression 
and multiple coriolation coefficients is iar inferior to the Doolittle 
method.* Kelley grants the superiority of the Doolittle method 
"for a small number of variables — perhaps up to 10," and recommends 
its use; but lie insists that the recent improvements on his iteration 
method make it the swifter instrument where a groat number of vari- 
ables are involved.® 


The Doolittle Method 

Tho Doolittle method is a variation of Gauss's direct method 
of solving simultaneous linear equations by substitution. Gauss 


* Carr, G, S • "A Synopsia of Elomonlary IlcsulU) m Pitro MntliomaticB,” 
Francis Hodgson, London, 1880, pp, 42n. 

> KoUsy, T. L.: ‘'Statistical MetUod." Pp. 302-310. 

Whittaker and Robison! Op. oU,, pp. 266IT, 

Edgeworth, P. Y.t A Now Molltod of lloducing Observations llolaling to 
Several Quantities. PMlosophtcal ilfojaiiinc Ser 6, Vol. XXIV, pp. 222-223, 
408-479; Vol. XXV, 1888, pp, 184-101. 

Ford, L R.: The Solution of Equations by (ho Mothod of Sucoossivo Approxi- 
mationB. American Afaf/iomohcol ilfontWy, Vol. XXXII, 1926, pp 272-287. 

* Kelley, T, L and Salisbury, P. S : Iteration Method for Determining Multi- 
ple Correlation Constants. ATnencan Stalulical Aasonation, Vol XXI, 1920, pp. 
282-292. 

Sabsbury, F S,: "A Simplified Method of Computing Multiple Corielntion 
Constants. Journal of Eduealimml Psychology, Vol, XX, 1020, pp. 44-62. An 
Improvement on the iteration mothod explained in the procoding article. 

* Tolley, H. R and Ezekiel, M. M. B ‘The Doolittle Mothod for Solving Multi- 
ple Correlation Equations m. the Kelloy-Saliabiiry Iteration Method. Ainertcan 
StalisHcal Association, Vol. XXII, 1927, pp, 407-600. 

* Kelley, T, L. and MoNoinar, Q.: Doolittle vs the Kolley-Sniiahury Iteration 
Mothod for Computing Multiple Rogrossioii Coofiicioiits Awimcan Stalislical 
AaaomlUin, Vol. XXIY, 1020, pp. 164-109. 
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developed eovoral inelhoda of solution— some direct, others indirect,^ 
M. H. DooUttlo of the United Blalos Coast and Geodetic Survey made 
various improvemonlB on Gausses method of direct substitution, and 
in 1878 published an account of his method.* Doolittle's method 
replaced Schott's version of Gauss’s approximation method in the work 
of the coast and gpodelic survey,* and found favor among engineers.^ 
In 1923, Howard K. Tolley and Mordecai M. B. Eackiol of the United 
States Bureau of Agricultural Economics introduced this method for 
the solution of the purlial regression cooffleionts (ICelloy's /3's) into 
statistical pracUco,® in which the writers adopted tho novel method 
of using the mean product sum, poi « iJoi/iV, etc., in the simultaneous 
linear equations, instead of the zero-order coefficients as is tho general 
practice. Mills adopted tho method as there presented for his text 
on economic and business siatisUos published tho following year.® 
Hull also uses tho onUro method as outlined by Tolley and Ezekiel in 
his 1028 book, "Aptitude Testing,”’ In 1925 Wallace and Snedeoor 

^ For Bornc of Onusa’g inolhods see, Merrimiin' Op, cti, olghth oclition Pp. 
18M87. 

WiUttakcr and Ilabjnsori: Op, eiLt Pl>. 284-230, 267-268, 

Enoko, J. F.: Uober die Methodo dor Klolnston Quadrate, Astronomische 
Jakrtyiick, Ikrlm, 1836, pp. 267-272; 1830, p, 206 Gauas'a chroot prooosfl for 
Aolutioa by elimination . 

Jacobi, K.; “Astmnornischc Nachriohton,’’ Altona, No. 623, 1845, p. 297. 
,Qau 80'8 incllvod of auoccoaivo approximations. 

Schott, C. A,: Bolutlon of Normal Equations by Tndlroot Elimination. 
Coast Sumy Itcport^ 1866, pp. 265-204. Oaiisa's indirect process of elimination by 
SUGCOsaivo (rmls and approximations revised and systematized for use m the coast 
aervoy. Tlila inotliod was largely used there for twoiity-livo years until replaced 
by the Doolittle method 

* Doolittle, M. II,: Method Employed m tho Solution of Normal Equations 
and the Adjustment of a Triangulation. Coast and Geodetic Survey Report^ 1870, 
pp. 115-120 

* Sob, Wright, T W. and Ilayford, J. F * ^‘Adjustment of Obsoivations by 
Methods of Least Squares,^' second edition D Van Nostrand Co , New York, 
1006, preface 

Also, Adams, 0 S ’ Application of tho Theory of Least Squares Special 
Publication No 28. Coast and Geodetic Survey t 1016. 

' Loland, 0. M.: “Prnotical Least Squaioa,“ Jirat edition MoGraw-IIill Book 
Co., New York, 1921, 

* Tolley, II, U. and Kssekio!. M. M, B. : A Motliod of Handling Multiple Corro. 
Ifttion Problems, American Sialiehcal Associaiiont Vol. XVIII, 1923, pp 993- 
'1003. 

« Mills; Op cH , pp. dOlff., 570-581. 

^ Hall, 0 L,. “Aptitude Tcatmg," fust edition. World Book Co , 1928 
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used the method, but with zet<i-ordor cocflictciit« itwUiatl of moan pro- 
duct sums, ill their little manual for ajtricullural rettoarcli workers,* 
Garrett, 1928, saw llmt zero-order coeilicienls could be Ku1>Klitutod for 
the mean product sums, but he evidently was unrnmiliiir willi Wallace 
and Sncdccor’a study, and he also flceni>i to have failed to invesligalc 
Tolley and Ezekiel’s reference to the Dnuhttle inellioil of wilution.' 
The writer would recoinnietul Wallace and Snedecor's atudy to etlucfi- 
tional psychologists as the clearest and most lulerpmte presenlalion 
of the Doalittle mclliod now iivaiUible, 


CONCWmlON 

Thtis wo have seen that the inothodH for obtaining the regression 
equnjWonB and the coeflicient of multiple correlation were hampered 
years by inadequatp niul cumberaome inclliods of solution, 
^ow that a synthesis of the most econoiiiical slalistical inelhnd for 
obtaining the regression equal lona, the purlial regression method, has 
been effected with the moat economical eiigiiieeriiig method for 
solving simiiltancoiiB linear equations, the Doolitli* inelliod, we may 
expect that the multiple corre.lalion and piediclion lechinque will bo 
employed to a much greater extent in educational psyelioltigy than in 
the past, 


* Wsllaec, II, A nnd Siictlecor, (J W,, “( 'orrclution amt Mncliiiii' ( !nli iilnlion " 
Othclat piiblicnlion, Vol, XXIII, No, 3,% lowu Nia(i‘ (V>ll{'g«« of ARnniUtire, 11)2<>, 

* Garrolt, II. B ; A Modillcnlion of Tolley niid Krekiid's nf llatidliiig 

Multiple Correlation ProlileniB. Journal of Eduftittniml PKycIttiliigiu Vnt. MX, 
1028, pp, 45-'10, 



THE SltfelKKACiK OF THE (’OEFFICIENT OF 
f MFI/riPLE CORRELATION' 

/ SKI.-Mint LAJf.SON 

i 

Cfirliloii Colh'M*', ^(iniimln 


iNTHODlUtlON 

It ha« ri'cr»Kiiia«Ml l>y llu'iirclical BtftliBticinnfl for some time 
timt H’fipn 'tJ»* coefficient of correklioii {R) is derived for a 

given set of data, uh viilm* i« likely to )>o deceptively largo. If the 
eorapuliitioHH liuve been correct, the vuliio will hold rigidly for the sot 
of dnln from', which the it* grcHsioii cquatum wna derived If, however, 
the equation idiould he iipplied to a second set of data, oven though 
strictly conipanihle, it has lieen supposed that the yield in this latter 
case woldd, except for errors duo to sampling, ho less than In the first. 
Moreover, it has been supposed that the more variables contained 
111 the rcgrcKsiou ettualiott, the greater this shrinkage will be. This is 
particularly significant because ordinarily the practical employment 
of a regression eiiualioii involves its use with data other than those 
from which it waa derived. If this shrinkage should turn out to bo 
very large, the building of multiple regression equations might well be 
abandoned. The matter is therefore ono of considerable importance, 
both tlicorelically and practically, Huvorol attempts have boon made 
by statisticians to derive a formula wliicli should indicate the amount 
of lliis shrinkage. Tlie mosl promising one of tliese will be considered 
in tlio present paper, iSo far us the writer has been able to di.scover, 
no one has allenipled to delorininc expeiimcnlnlly tho actual amount 
of shrinkage. The present icporl describes such an attempt in the 
field of psychological lesliiig, 

A study of the shnnkago is iiiado by using a regression equation 
derived from ono group of subjecls to predict the criterion scores of a 
second group. The coitelulion yield by this proceduie is subtracted 
from the yield olilained by predicting the ciiteriou scores of the second 
group by means of a l(•greMaiOll equation derived from themselves. 
This shrinkage is sUidied with llu* mimbor of tho independent variables 
in tlie regiesHion (>(|Ualioi) rungini:; from one to ten in mimbor and for a 
variety of difft'ient eiiteria. A comparison is then made between 

* Fioiii till* IVyrlioloKiral LHl)OiiiU>r\, iriuveisily of Wisconsin. Ihc writer is 
Breath imlebieil to I’lofrHwir M, V O'Slieii foi pciini'wiOii to use data srioctod fiom 
tho results oliliuiiftl l>v Hie MiKSiasippi Survey 

4(5 
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such empirical findings and the lesults obtained by applying a recently 
proposed formula for determining the same type of 8hri|nkage.^ 

Source and SbiiEction op Data 

Something like 30,000 pupils were given mental and Ojchiovement 
tests in a survey of the school system of the Slate of Mississippi 
For the present study, the test scores of eight hundred high school 
pupils from this number were used The scoics of pupils fiojm the large 
and medium-sized high schools were chosen in the belief th^at the level 
of instiiiction would be more nearly iimfoim ^ The entire; population 
of eight hundred consisted of four groups — two hundred boys m each 
of two groups and two hundred gills in each of the two leraainmg 
groups. The subjects to make up these groups wcie chosen from those 
tested by the survey m buch a way that each of the four contained 
exactly the same number of individuals diawn fiopi any particular 
class of each school sampled, Oihoiwise the placing of the subjects 
in the several groups was entirely at laiidom By making up the 
personnel of the gioups in this manner it was felt that they would be 
as exactly comparable in regard to general level and range of natural 
endowment, culture, and educational ooportunilics as possible. 

Each pupil had eighteen scores enleied aflei his name. The 
designations aie as follows. 


Zt English 

Xi Martlifematics 

Xa Science 

Xi Hiatoiy 

Xb Chi onological ago 

X« Intelligence quotient 

X7 Information (Teiman) 

Xs Best answci (Torman) 

Xfi Word meaning (Tcrnian) 


Xio Logical feclcctvons (Tcunan) 
Xu Authmetic (Toimnn) 

X12 Sentence meaning (Tciman) 
Xn Analogies (Tcunati) 

Xu Mixed sentences (Teinmn) 
X16 Classirieatious (Torman) 

Xm Kumber S011C3 (Teininn) 

Xij Total Tciman 
X18 Total Iowa 


The first four X's together with Xia aie scoics made on the Iowa 
High School Content Examination. Xy to arc scoics made on the 
Terman Group Test of Mental Ability Another column — the sum 
of each row — was added for checking piuposes 

^ Ezekiel, M. J B, An unpublished paper read before the Matlioinaticcil Society 
at its annual meeting m Chicago in December, 1028 

^ O'Shca^s study showed that for the state ag a whole Rcholastic acliicvcment 111 
the small high schools was decidedly lower than an the laigci ones, 
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EmPIIIICAL DbTini'MlNATlON 01* SlIIlINKAGE 

Paht I 

Ten (Ustinct icgirssion oquationa with lOiighsh ns the criterion 
wore derived from tlic {iiitn for the first gioup of boys. Ten parallel 
rcEies.sion equations weie denved from the data for the second group 
of boys. In tire ease of the first groiipj the first equation had all 
ten iiidcpoiidciit varialilos (teals) The second equation had the best 
nine test variables, t.c,, those Iraving the higlicsl criterion corrolation.s. 
The third bad the best eight test vniiablea, and so on down to the tenth 
equation which was baaed on the single test having tho highest criterion 
correlation. Tlie same piocedure was followed with the second group 
of boys, except that in this ease the same test variables wore used in 
the corresponding equations ns were used witli the first group. Owing 
to a natural vaiiability in the size of the zero older correlation coeffi- 
cients from sample to scunjilc, llic tests successively excluded from the 
progressively smaller equations with tlio second group of boy.s wore not 
in all eases the next in order of weakness in tlio criterion r’s 

Space is lacking for the presentation eithoi of the means and 
standard deviations needed for the derivation of tho regression equa- 

Tadli} I — Zbho Ordku ConprioiKNTfl op Co«itBi.ATioN pon Both Sets op Boys 

Tiio Bold Face Figmos at the Upppi lliglit Arc tlio Coofficicnts of Correlation 
for Boys, Set No II; and llir Light Fuco I'jguics at the Lower Lclt Arc the Cooffi- 
eienfa for Boys, Set No I At tin* 'fop and Loft of Tabic Aic Indicated tho Vari- 
ables Whoso Nolatioiifl Aic Outlined Eailioi in tho Tc\t 'riiis Table Sltowa How 
English (A'l) Correlates witli Each of the Items in tho Torraan Teat and Also tho 
Inlcicoi relictions between llio Vaiioiis Items 
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jiQijg oj. for the icgr(*‘'''ictn cf null ions rln‘In^^^(•H ' In indci lliiil Ihc 
interested render inny nhuly llie I lie ongiiml 

correlations and thoMiveial iiiiilliple i-orielation yield-', (line li-is heeii 
plncecl m Table I (li<’ I'liliie eerie*- of yem erder eoin InfKiii euellii'ieiils 
for both groups of liojs. The enellicieiils of I he re‘-peeli\ e giiiii[)e ;iie 
dislingiiiahcil by meiiii.s of eoiilnisling (yjir* fnee,- All of llie (oelh- 
cicnts me positive. 

'flic miiltiplo con eliil mil etK'fl'ieienls denveil fiem ihe lesnllseliown 
in Table I are given III Tiihle li. 'Die /f’h eMire'-iiinidiiig to llie .-evi'nil 
multiple regre.ssion etjuiilmiis thuivid fnmt the hors of (Ironp 1 are 
shown in row A and those for (lionp It in lov. h 'J'lie'-o vnliu'.s aie 
the condation eoefllcieiits wliiidi would have heeii ohlniued if m 
ciich case the test scoies fioiii wliieh Ihe legiessioii ei|iui(ion was 
derived had been substiliited niniHumtUelv in llie eipuilioii itself anil 
the lesulting ciilerioii estiiiiales had heen eorielaled with Ihe line 
criterion in the ordinary way Aelimlly, tliesi* Miliies iseie oliliiinetl 
by means of the u.siial fnrnml.t ivliieli is deeidedly siniplei The 
eocffieionts m hofh aeiies jiri* dislinelly high, as a|)liliide eoi leladori 
yieldaum. It iH iio(e\v<uthy, liowever, that ui Imdi M'lies alike, after 
three tests have been uieliided in (he ei|n;i(mn, tin* iirldilion of all (hr* 
remaining soven tests Kiiiliee.s to raise ilie eorielalirni yiehl a iola.1 of 
barely a singlu point in llu* seioiid deeiiiiul plari'. 

Tlio next Hlep in Ihe pioeess was lo snltsinule (he aepml (est 
stores of the boys of (troipi I in (lie ecpialioiis deuve<l fioiii (tioiip [I 
and to correlate the lesulliiig eiileiiriti esiunaies wiih Ihi* line eiilerioa 
scores of Group I The lesuKing senes of eoelln lents is givi ii iii 'ruble. 
II, row The pioceduie was then leieiseil 'I’lie line nihuion 
ol Group II was conehiled with Ihe cnieimn esiimuies ohtaiinal by 
substituting tlieir lelevanl (esi .seoies iii (hr eiiualmns derived from 
the scores of Clioup I. The lesnllmg eoellicients mr* gneii in low li. 
We now have the values fiom wlneh shimUjige,-- iu,i\ he deteruuiied, 

Acooiding to tluiftyirooi expeelalioii as mdiealed iilioie, the values 
in row B should show u peieeplitile shiiiiKiige wlieii eonipaied with the 
values in row yl niul siinihulv with low h wlmii eompaied wilh law Ih 
Abnef comparison of the I{ miIiu's m ihe two leiiis of lows shows lhat, 
except for tho e(nialion eonlaining Inil a eiiigle ti‘s( laiialile, tins 
expectation is leatized. 'Phe aiuoniil of (he slmnkage is shown in 

'Tlioso ftTO given in ileluil for llie < n on* uliiih in lie' inillioi 'h iIi- h'i hi I inn lilnl 
in llio libiaiy of tlio IJiiiverhilv of Wimoiisih ti ii iiitillul ".'-■tiidii’, m \|iti(iii|i' 
ferecasting Willi tlin Mnlliiile Uegi. -si.iii Ibinul •' 
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row 0 for tho several pairs of values of Group I, and for Group II 
in row F. The mean values for rows C and F are given in row <?. 
A glance at these latter values shows at once that, despite a certain 
amount of variability presumably due to sampling en'ore, there is a 
clear tendency for the shrinkage to increase with tho increase in the 
number of independent (test) variables in the xegression equation. 
This again is m harmony with what has been believed by statistical 
theorists. A graphic representation of the mean shrinkage values 
shown in row 0 is presented as the solid line in T’ig, 1 



Fig. l.^ShPinVage ta obtained by the use of the fomule 
and also ae obtoined experlmsTitelXy. 


We have seen that the increase in the size of ii, even when regres- 
sion equations are applied to the same data from which they are 
derived, is extremely slight and grows less and less as tho numboi of 
test variables increases We havo also seen that under the same 
condition the amount of shrinkage in yield fiom such equations when 
in actual use grows greater and greater. Tho question naturally 
arises whether there may not be a point beyond which the increase in 
R resulting from the addition of a new test variable may not be more 
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than offset by the inctoaso in shrinkage^ so that the tiiio functional 
value of such a tost l)atlciy or othoi oblimating aggregate may not bo 
actually Ics’^ than if the lest or othci indcpeadenl variable had not 
been added, An examination of rows B and E shows that in the 
case of both groups alike such a critical point is reached at the eighth 
test added. In both ((t.^es the ballenes would hava given aii absolutely 
higher forecasting yield with two of ike tests left out. The moral of this \s 
that under some circunislaiiccs the inclusion of ccrlani tests in an 
aptitude battery after it has reached some si7/C may not only entail 
the waste of energy and inaterinls of administeiing the test, but may 
actually reduce the yield, and thns even when the best possible method 
of weighting the tests is employed. 

Patit II 

To secuiG fill ther empirical evidence as to the amount of shrinkage 
from the ordinary multiple coirclation coefficient, further computations 


Tablu III — SiiowiNU Tim SiiumKAa® op When the Same (10) Test 
VAniAnLEs Ann Used hut Dipkerent Academic Subjects Aim 
Employed as Oiiiteiita with Pjpperbnt ConnELrATioN Yields 




English 

Mathe- 

matics 

Science 

Iliatoiy 

Total 

Iowa 

Boys’ Group II, 

Coriclation yield (^J) fioin 
equations denved from the 
fiubjccta’ own scores 

A 

7800 

! 

i 

6431 

1 

5680 

7719 

8200 

Correlation yield (R) from 
equations derived from the 
scores of Gioup I 

B 

7786 

6148 

5230 

7605 

8098 

Shrinkage 

C 

0083 

0283 

0459 

0214 

0102 

Girls’ Group II 

Correlation yield {R) fiom 
equations derived fiom the 
subjects’ own scoics 

D 

7089 

6403 

' 4548 

7115 

7875 

Correlation yield {R) fiom 
equations deiived fioin the 
scores of Gionp I 

E 

7665 

6226 

4210 

6786 

7766 

ShnnkagG 

F 

0324 

0177 

, 0329 

0329 

0120 


wcie undertaken in all of which the number of test variables was kept 
constant. The number chosen was the maxinfium for this study 
ten The multiple regiession equations on mathematics, science, 
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history, etc , for the boys of Group I were used to estimate t|he corre- 
sponding true critciion scoies of Group II The same proccclUire was 
followed foT the gills I 

The results are given in Table III which is constructed in a| mannei 
compamble to Table II above With the number of test i|ariablc8 
constant, this table enables us to obaei ve the lufliience upon the amouat 
of shrinkage of the strength of the natural tendency to corrol ation m 
the test data involved. If we divide the ten shrinkages foun( I m this 
senes into two groups on the basis of the size of the oiigi aal 
we find that the average shrinkage for the five largest ii's jis .0169 
whereas that for the five smallest R's is 0315. The tendcnci| for the 
weaker sets of data to yield the laiger shrinkages is evident. ; For the 
two lowest values (Science) this amounts to .0394, a very appreciable 
amount ^ 

The Smith Shiumkage-dedugtion Foiiimxjla ‘ 


A promising correction formula has been dovolopcd to apply 
to the coefficient of multiple correlation A paper conlaimng the 
formula was read by M, J. B Ezekiel at the December 1928 meeting 
of the Ameiiean Mathematical Society held at Chicago. This 
formula ig 


1 7?2 _ 

= 1 - - — or 
I V} 

n 


n W m 
n ■j?! 


where R <=• the estimated correlation obtaining in the universe 
R the observed coi relation 

m = the number of variables, dependent and independent 
n ^ the number of observations (statistical population) 

Ezekiel gives the credit for developing this formula to B. B. Smith. 

At the completion of the computations described in the preceding 
section it was a relatively simple task to substitute in the above formula 
and determine for the vaiioua observed i?^s, the ooiresponditig esti- 
mates of the ^^correlation obtaining m the universe ” These values 
are given in Table IV for the R's obtained m Part I Table Y shows 
the corresponding values of the R's obtained in Part II Subti action 
from the original shown m Tables II and III respectively yields 
the amounts of shrinkage which would be anticipated by the founula 
in each case 

In Table IV low E shows the mean amount of shiinkage foi each 
pair of observed R values foi the several numbers of test vaiiablea, 
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It IS plotted lu Fig. 1 for the puipose of easy comparison with the 
empirically deteiminod shrinkages. It is clear that the formula 
definitely parallels the empirical findings It conforms to the observed 
tendency for the amount of shimlcage to mciease with the number of 
variables involved m the equation There la a well-maikcd tendency, 
however, for the Smith foimula to indicate malenally largei shrinkages 
than the empirical results sho-vv 

Passing to Table V, we may make the comparison with the empirical 
results by treating the shrinkages the game as those in Table III 


TABiiB V — Showing the Shiunkagb of as Indicated hy the Smith 
Formula, Where the Number of Vartables Is Constant hut the 
Size of the Vary Rather Widely 



1 

English 

1 

Malhc- 

maties 

SciGllCC 

Ilistoiy 

Total 
^ Iowa 

Boys’ Gioiip IL 

Oori elation obtaining in the 
univciSG {R) as estimated by 
Iho Smith formula , 

C 

i 7727 

6155 

5330 

7663 

8094 

Shrinkage obtained by sub-' 
h acting low A above fcrom 
low A m Table III , . 

B 

0142 

0275 

0350 

0166 

0106 

Girls' Gioup II. 

Goirolation obtaining m the 
universe {R) as estimated by 
the Smith formula 

C 

7843 

6132 

4006 

0916 

7730 

Slirinhnge obtained sub- 

tiacing low C above fiom 
low D in Table III 

D 

0146 

0271 

0543 

0199 

0145 


Computation shows that the mean shrinkage of the five largest It's 
is ,0139 wheieas that for the five smallest is 0329 Heie again we 
observe, as in Table IV, that the sluinkages yielded by the formula 
are materially larger than those found empirically. An analysis of the 
formula reveals that the shrinkage increases as the size of the obtained 
R decreases. The formula will break down, however, when m/n> R^ 
as the values will then become imaginary In this situation, with m 
equal to 11 and a equal to 200, the formula will give imaginary values 
when the absolute values of B are less than 235. 





StjMMVH’l \NI> 111 .•’ION-' 

1 The present iiivesfigafioii vlimvii fhsi ‘li*- ‘Jji Ji'' jUv 

expected shrinkaK(‘ of //as <i<Tn.-«l l»y Hi.- niulupl.- .-.rf. f.,,,,.,,) s 

IS n fftot- , . 

2 Thcslmuknge is found Itt increase ns iiM' i(iiinli''rtil i> » - 


increuaviD. 

3 ThoslU’inkngc i« also found tn iioTr.jf'i' !i ‘ ) Ic -i.s •.) /.’ i|. > i- r 

4 TheSmitliRlimikaK(‘-dcdtu-lioi( foriiMil‘1 ii ir ill* 1 • dl •*} do d‘in«' 
empirical fimlinRS, but (|Ui(<’ roiisishoiflv liu'i vihe^ vdn. b -uo tu 
excess of those obtained under »)«• prej-eti» e\)HTiiJi>ud’il I'oudilMii . 

6 The cinpiricnlly iiliserved i-liniikitK<' uier^'itsi lol tui li n r widi 

the increase in the number of icfiL variables iba) oiUMif ({(«• wjd> ly 

known scbolaatic aptitude (csts ncliially eliows a Piwir • nrr* ! s«!iiu 
yield with a crilerion wlien (eii tol mills are n-ed ilnu ulen oid> 
eight aro employed. Tiim MiugeniK ilmi balivro >o')\ lei\eMJv 
definite limitations as lo .‘'I'/e 



THE INFLUENCE OF BLOOD RELATIONSHIP AND 
COMMON ENVIRONMENT ON MEASURED 
INTELLIGENCE 

VERNEll MAHTIN SIMS 
University of Alnbamn 

One of the favorite modes of attack used m the mvestigation of the 
relative influence of heredity and environment on intelligence as meas- 
uied hy the tests of today has been through a consideration of the 
resemblance of siblings (bi others and sisteis) in the trait or traits 
moasuied by these tests These studies aie numerous^ and have 
invariably shown a decided coirelation between the intelligence of 
siblings Intel estingly enough, this correlation coefficient is about 
the same as the coirelation found between the physical characteristics 
(eye coloi, cephalic index, stature, etc) of siblings — appioximately 
60, However, this similarity between the physical and iniellectual 
leseinblance of siblings does not necessarily mean that the relationship 
is deteimined by the same caueative factors The physical char- 
acteristics aie seemingly uninfluenced by environment, but the siblings 
aie ceitainly subjected to a common environment, and, until evidence 
IS produced that this is a negligible factor in the case of intelligence, 
the correlation has no significance In lecent years this fallacy has 
been pointed out tune and again. It but leinams to attempt the 
determination of the relative contributions of common environment 
and blood relationship to the cou elation which is found 

One of the most satisfactory approaches made to this problem 
that has come to the writer^s attention is Gontained in the Chicago 
study reported in the 1928 Year-book of the National Society for the 
Study of Education ^ In this study the coiielation between the 
mtelligenee of siblings leared m the same home was compared with 
that of siblings who were separated before either child was six years 
of age Instead of the usual coirelation of 60 a coirelation of ,32 ± 05 

^ Foi careful summaucs of most impoi tant of tlicse studies see Bulks, Bailiara 
A SiHumaiy of Liteiature on the Hetei miners of the Intel ligctico Quotient and the 
Educational Quotient, Twenty^ seventh YeaThooh of the National Society for the 
Stiuly of MifJcaUon, 1928, Part H, Gimp, XVI, pp 262-261 

^Fieoman, Ilolzmgoi, and Mitchell* The Influence of Enviioiiment upon 
Intelligence!, School Achievement and Conduct of Foster Ghildicn, Twenty-seventh 
YearbooL of the National Society Jot the Sludy of Education, 1928, Fait I, pp 128- 
135. 
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(by agB paiung) oi ,26 ± 06 (by double entry pairing) waa found 
between the intelligence of one bundled twenty-five pairs of siblings 
who had been separated for an average of seven years and four mouths 
and had an average age of five years and four months at the time of 
the sepaiation This seems to bo rather convincing evidence of a 
decided enviionmental influence, The chief weakness of the study 
lies in the fact that all the enviionmental influences have not been 
eliminated, since those siblings had for a peiiod of years been subjected 
to a common environment. The moie than five years spent in the 
same home probably accounted for a part of the correlation found, 
In fact, piesent day tendencies in psychological theoiy would seem 
to indicate that the most significant peiiod of their life had been 
spent in a similar environment From the data which they had at 
hand it was impossible to determine the extent of this influence. 

The study reported in this paper represents a different attack on the 
same general problem The procedure used here in the attempt to 
answer the question of the i dative influence upon intelligence of blood 
relationship and common euviionment was to compare the correlation 
between the intelligence of pairs of siblings fiom the same home with 
the con elation between pairs of unrelated chiJdien, the unrelated 
pans being equated with the sibling pans on the basis of age, school 
attended, and homo background Tho significance of the correlation 
between the intelligence of siblings can only be inteipioted in the light 
of information as to the con elation that would be found if the members 
of the pairs wcie unrela-tcd Piesumably children paired at random 
would show no resemblance, but one cannot compaie paired siblings 
with random pairs and account for the differences in terms of inherit- 
ance, It is only when enviionmental influences arc equal that oom- 
paiisons have meaning. In this study the attempt has been made 
to equate two sets of paired childion on the basis of enviionment, the 
members of each pair in one set having the same parents while m the 
other the members of a pair have diffeieni parents. To the extent 
that these conditions have been met, the diffeience m the degree of 
relationship between the members of the first set compared with the 
second set can be consideied as a mcasuie of the influence of common 
parentage. 

During the spring of 1927 the writer coopeiated in the testing oJ ah 
children found in Grades V to XI in five school systems in Lincoln 
Parish, Louisiana Foiii of these schools were eleven-grade con- 
solidated ruial schools, the fifth system consisted of two elemental y 
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schools and a high school located m a town of appioximately 6000 
population. The Otis Self-admmistonng Tests of Mental Ability 
were used to measuie lutelligcnco, and the Sims Score Card for Socio- 
econoimc Status was used as a measure of homo background The 
Otis Intermediate Test, Foim A, was used for Grades V to VII, and 
the Higher Test, Form A, for Grades VIII to XI. On the basis of the 
scoies made on the Otis Tests the IQ’s were deteimined by the proce- 
dure lecommendcd by Otis in his “Manual of Ducctions." The 
reliability of the Otis Tests, as reported by the author, is high (.96 
for the Intermediate Form and .92 for the Higher Foim), The 
validity IS more difBoult to deteiraine, but high correlations leported 
between this test and other tests of intelligence would seem to indicate 
that it is measuring approximately the same thing that all of our 
intelligence tests measure The reliability and validity of the Sima 
Score Card has been discussed at length elsewhere. ^ Suffice it to say 
hero that it has been shown to adequately diflcientiale between groups 
with known diffeiences in home environment; and the reliability, as 
determined by correlating the scores of childicn from the same home, 
has been found to be rather high, approximately 90. The coefficient 
of reliability determined from one hundred pairs of sixth-, seventh-, 
and eighth-grade children was 95, and the coefficient found by 
correlating the Scores of the two hundred three pairs of siblings reported 
below was .87. The i datively low reliability of the data used here 
may be due to the fact that some of the examiners were not very 
skilled m testing, but there ia evidence that high school children 
ropoib a slightly higher socio-economic status, perhaps because 
certain of the items included in the scale are actually more frequently 
possessed by older children This increase is, however, veiy slight, 
being less than one-third of a point a year, and, although it does 
lower the reliability of the measure, it is still reliable enough for our 
purposes. 

From the tested population described above, each child reporting a 
brother or sister living in the same home and enrolled in one of the 
schools and grades included m the testing (Grades V to XI) was selected 
and his record paired with that of the brother or sister reported. 
These siblings were paired in all possible ways, that is, where three 
siblings were tested they were grouped A with B, A with C, and B 


' “Tlio Mensuremont of Socio-economic Status.” Public School Publishing 
Co , 1928 
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with C. More than ihreo siblmgs wore not reported m any case. 
This pairing seems to be the generally accepted one when the number 
of siblings found in any one family is not large Two hundred twenty- 
four such pairs, coming from one bundled oighty-Lwo homes, were 
secured, but for leasona explained later, twenty-one of these pairs weie 
discarded, so that two hundred three pans from one bundled sixty-one 
homes composed the mam group used in this study. 

The unrelated pairs were prepared by substituting for one member 
of each sibling pair an unrelated child coming from the same school, 
and having the same age and home background. The procedure for 
piepaiing one of these unrelated pains was as follows. Eoferring to 
the school where the younger sibling was enrolled, that child with the 
same home background score and most nearly the same age as the 
younger sibling was selected. When two or more childien were found 
to fulfill those requirements to the same extent, one was chosen at 
random from the number. In the same manner the child most nearly 
a duplicate of the oldei sibling was selected The one of these two 
selected children nearer the ago of the sibling which he was selected 
to duplicate was taken as one member of the unrelated pair and the 
other sibling as the second member. In no case was a child selected 
whose age was not ..within one year of the sibling and whose home 
background score was not within ono point of the sibling's score, or 
the average of the siblings’ scores m cases where there was a difference 
m the reported home background score of two siblings If no such 
child could be found, the sibling pair was discarded. The twenty-one 
pairs of siblings mentioned above as being eliminated from the study 
were discarded because no unrelated pair could be found to match 
them 

In this manner a group of two hundred three pairs of unrelated 
children having the same age and home background and coming 
from the same school as the sibling pairs were secured Withm the 
reliability of the measures used they differ fiom the sibling pairs only 
in the absence of common parentage. Table I presents the average 
age and socio-economic status (with the standard deviation) of the 
two groups, the young membcis of the pairs being contrasted with the 
old members In addition, although it is to be noted that they have 
not been paired on these bases, the mean grade and IQ (with the 
standard deviation) is reported, 

That the groups used here are fairly representative of the popula- 
tion from which they wore selected is shown by comparing the averages 
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and sigmas for mtelligonce and socio-economic status of the siblings 
and unrelated pairs with the total population. The total population 
tested consisted of 1018 cases and the average IQ was 90.9 (with a 
standard deviation of 15,6), while the average socio-economic status 
was 14 7 (with a standard deviation of 5 9) 


Taulb I.— Showing the Mean Aqs, Sogio-ugonomic Status, Guaum and IQ or 
THE Sid UNO Paihs and thd Unbeijated pAiiift 



N 

Ago 

S-E-S 

... 

Giade 

IQ 

Monii 

Sigina 

Moan 

Sigma 

Moan 

Sigma 

Mean 

Sigma 

Yoimg member 










Sibling 



2 0 

12 4 

6 4 

7 2 

2 1 


IS 4 

XJm elated. 

203 


1 9 


6 4 

7 3 

1 7 


14 7 

Old membei 










Sibling 

203 

16 9 

2 1 

13 4 


9 1 

1 8 

87 3 


Unrelated 


15 9 

2 2 

1 

13 5 

5 4 

9 1 

1 8 

87 5 

13 3 




1 







and young 










Sibling 


2 9 

, 

mm 


m 


4 5 


Uni dated 

' 





1,8 


3 8 



Compaiison of the sibling and uni elated groups shows then great 
similanty. The differences between the members of the sibling pans 
(young against old) is seen to be practically the same as the differences 
between the members of the unrelated pairs The average diffeience 
in age is approximately three years, and in giade approximately two 
grades; the old members score slightly higher on socio-econoimc 
status; and the younger mcmbeis have the higher IQ One is struck 
by the fact that, although no attempt has been made to equate the 
groups on the basis of either grade or intelhgenee, theie appears to be 
just as much similarity between the two groups on those measures as 
on the other two ' 

Certain factors may independently affect the intelligence of mem- 
bers of pans such as those here used; consequently the degree of 
correlation found between the paiied cases is influenced by the method 
used foi entry in the coiTelation table. Because theie is yet some 
doubt as to what is the most satisfactoiy method, in the correlations 
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reported hero two methods were used. By the first (known hereafter 
fts the nge-painng method) the score of the young member was always 
enteied on the veiLicul axis of the correlation table and the scoie for 
the coriesponding okl incrabei on llie horizontal axis. By the second 
(known as the double-entry method) each pair of scores was entered 
twice, witli the young on the vertical axis and then with the old on the 
vertical axis.^ 

The correlation between the IQ's of the siblings and the correla- 
tion between the IQ’s of the unrelated pans, using the two methods, 
are ns follows; 

r (Acb PAiniHa) t (DoTnii.B EnmtJ 

Siblings {.N = 203) i4 ± 04 40 + 04 

Unrelated {N = 203) 35 ± 04 20 ± 04 

On the surface, at least, it seems that these correlations, between 
the intelligence of the members of the sibling pairs and between the 
intelligence of t\ie unrelated pairs, should be indications of the rela- 
tive influence of common emirommrd plus common parentage, and of 
commmi eninronmenl only on intelligence as measured by a group test, 
that 18 , common environment pi educes a coi relation of 35 or .29 
depending upon the method used, while the addition of common 
parentage raises this correlation to .44 or .40 again depending upon 
the method used The writer is inclined to believe that these are 
the most significant coriclations reported, but Iheie are undoubtedly 
certain factors which might influence those coefficients that make it 
undesirable to accept them at face value. It has been pointed out by 
numerous mvestigatois that there i.9 a decided relationship between 
age and intelligence, consequently the coefficients for the members 
of each group is being thus affected. For compaiative purposes, since 
the age factor is presumably operating the same in both cases, it la 
peihaps of small matter; but it seemed desiiable to see what the conela- 
tion would become when age is kept constant. Partial corielations 
with ago constant weio determined foi the sibling pairs and for the 
unrelated pans. In determining these coiiclations the age pairing 
method was used. These corielations were, for the sibling pairs 48, 
Mvd for the unrelated pairs .34 In other words, this coirection for age 


'In iiaing thcio two inolhocla wc nro following the piocccluro of Fiecman, 
Iloliiiiigcr, and MjtohcU in the study mentioned above 
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has not seriously affected the relation between the coefficients for 
siblings and for unrelated pairs 

It will be recalled that two forms of the Otis tests were used for 
testing the intelligence of the subjects Otis reports a con elation of 
only 84 between the two forms, consequently IQ^s detoimmed from 
different forms are not exactly comparable- In order to determine the 
influence which, the use of two forms might be having on the correla- 
tions found, those pairs where the child substituted to make an unre- 
lated pair was not tested with the same foiin as was the sibling for 
which he was substituted were first eliminated * Coefficients of 
correlation were then determined for: (1) those cases wheio both 
members of the pair were tested with the intermediate form, (2) 


Table II — CoMrAiiisoN of the Courblation between Intelligence of 
Siblings with Unublatbh When the Same Form Was Used 



t- (A<3B PAintNQj 

r (Double Enthy) 

Intormcdiato foi m 

Sibhnga (N =64) . , 

48 ± 06 • 

49 ± 06 

Unrelated {N =» 64) 

37 ± 07 

32 ± 08 

Higher form" 

Siblmgs {N — 56) 

55 ± 06 

48 ± 07 

Unrelated (A^ »= 56) 

43 ± 07 

30 ± 08 

Both forms' 

Siblmga (y — 66) 

45 ± 07 

41 ± 07 

Unrelated {iV - 66) 

'31 ± 08 

31 ± 08 

Composite- 

Siblings (N = 175) 

51 ± 04 

49 i 04 

Unrelated (iV = 176) 

30 ± 04 

37 ± 04 


those cases where both members of the pair were tested with the 
higher form; (3) those cases where the young member was tested with 
the intermediate form and the old member with the higher foim, 
and (4) the composite of all cases. The correlations between the 
intelligence of siblings are compaicd with those between the iini elated 
pairs in Table II Considering the composite of these cases it will be 


^ Since au ■unrelated pair was made by aiibstituting that child in the school who 
had most nearly the flame homo background and age, but not neccssaiily the same 
ffradc, as the eiblmg, it somofcimca happened that tho substituted child had hcon 
tested with a different form fiom that used on tho sibling 
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noted that although the coirclalions Imvo been raised slightly there is 
no serious change in the lalio of the unrelated to the sibling. Compar- 
ing the correlation found when the members of a pair were tested by 
the same form with that found when the members of a pair were 
tested one by one, foiin, and the second by the other, we see 
evidence that the use of two foiins is probably reducing the correla- 
tion, but wo also see (hat the .siblings and imrelaled arc reduced to the 
same ex ten 1 

A final factor {hat needs to be iakoii into con&ideiation m the 
interpretation of the cooflioionts that have been found in this study 
18 that of selection What would be the effect on the correlation found 
if wc had available all of the brothcis and sisters of the siblings used? 
Wlmt would be the offccl if wc had all of the children in the community, 
or even in these schools, who were of an age and from such homes as 
to make them suitable for use m the picparation of our unrelated pairs? 
We have made an attempt to answer these questions. Presumably 
pairs with age differences such as those of the cases used here made 
up at random would show no coirelation between intelligence. As a 
check on the validity of the method of paiiing used here — m order to 
ace if it operated in sueh a way as to select pairs with like intelligence 
independent of the factors which wo have assumed to be causing the 
similarity — a third set of paired cases was piepared. These paired 
cases were made by selecting for each sibling that child, in the same 
school (and in the grades included in the study) having most nearly 
the same age as the sibling. When the neaiest age was found to be 
represented by several childicn, one was selected at random A 
duplicate for each sibling pair was then secured by taking the selected 
child neaior in age to the sibling he was selected to duplicate as one 
member, and the other sibling as the second member In this manner 
a set of two bundled thice pans of unrelated childien having the same 
age and coming fiom the same school as the siblings was piepared. 
Since they have been paiied without legard to either blood lelationship 
or like home background, the correlation should be zeio. The correlar 
tion actually found, by age and by double entry-paiimg lespectively, 
was 06 ± 05, and .04 ± .06 It appears that whatever selection is 
operating is very slight, and it is presumably affecting the siblings 
and the uni elated in the same way. 

To summarize, then, siblings leared in the same home have been 
found to have a correlation of approximately 45 between their intelli- 
gence quotients as determined by a gioup test, while unrelated pairs 
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equated with the sibling pans on the basis of age and homo backgioiindj 
and attending the same school as the siblings, have shown a correlation 
between their IQ's of something in the neighborhood of 30. 

Attention should bo called to the fact thiii the crudeness of our 
measure of home backgiound is operating in such a way as to increase 
the difference between these two coriclations The siblings have been 
reaied m the same hovic^ and to the extent that this moans common 
environment we ai e sure they have it The unrelated pans have been 
reared in different homes, but homes we have assumed to be alike 
because they had the same score on the scoie cauU To assume that 
two children have the same home background because they have 
the same seoie on this scale is unreliable to the extent that the measure 
IS unreliable, but to compaio children equated on this basis with 
childien actually leared m the same home has an added factor of 
unreliability caused by the failure of the score card to measure all 
of the finer environmental differences found among homes that are 
seemingly equal The coefficient for the siblings is not subjected 
to this factor, which is almost sure to attenuate the coirclation for 
the unrelated pairs, In other words, if we could find unrelated pairs 
that had actually been rcaied from birth in the same home wc would 
expect a coireiation between unrelated pairs that would move nearly 
approach that found for siblings One feels sure that the influence of 
blood relationship on the intelligence of siblings is not being under- 
estimated when the difference between the coefficient found hero for 
the siblings and for the unrelated pairs is taken as its measure. Since 
unrelated childien who, within the reliability of our measures, have 
been equated with siblings show the resemblance that we have found, 
it seems safe to say that the common environment to which the 
siblings aie subjected accounts for a correlation between their IQ's 
of at least ,30, while blood relationship is potent enough to raise this 
coefficient to .45 

In conclusion wo should call attention to the fact that throughout 
this paper we have been considering intelltgence as measured by a 
group test The fact that high correlations have been found between 
various group tests of intelligence, and between gioup tests and 
individual tests, would lead one to beliove that similar results would 
be found whatevei the test used This, however, does not wairanb 
the assumption that there is not some quality in the human, some 
native capacity, which is inherited. The losults may be interpreted 
as a condemnation of present day ^intelligence' tests oi as evidence 



Jiijluence 0/ Relaliomhip and Environment 

that intelligence is not solely inhonlccl, but rather a development 
to the Btctpli.y ot cnvieoumental form on horeditniy chnraotaisto 
The intorpteWloa thal one may eivo ll,o fiml.ngj „ „ ™ 

but the indicatione are lliat Inlolligouco, so far ns m are today abk 
lo measure it, is gicatly influenced by environment. 



THE EQUIVALENCE OF JUDGMENTS TO TEST ITEMS 
IN THE SENSE OF THE SPEARMAN-BROWN 
FORMULA! 

II H REMMERS 

Pin due Umveiflity 

Thb Problem 

A previous study by two of my studenLig and myself ^ reported au 
investigation in which a summary of the experimental literature indi. 
cated that ^'the Spearman-Brown prediction formula shows it to give 
meaningful prediction on such materials as mental test items, spelling 
wordSj [judgments of] lifted weights, true-false items in language, and 
component units of rating scales. ” This previous work was done by 
a number of different authors — Kelley, Holzinger, Clayton, Ruoh, 
Ackeraon, Jackson, and Furfey* 

Our own e^tperiment at that time reported results on the Purdue 
Personnel Rating Scale which indicated that summations of ratings on 
ten different traits fell within the limits of allowable error when the 
values of empirically observed correlations for varying numbers of 
raters were compared with those predicted by the Spearman'^Brown 
formula That is, the formula did predict with reasonable accuracy 
the reliabilities to be expected with an increase in the number of judges 
or raters 

The typical situations m which judgments or ratings are obtained 
IS frequently limited by the fact that, assuming the Spearman-Brown 
formula to apply, the number of judges is too amah to give ratings 
sufficiently reliable for practical purposes 

The piesent study is the report of an investigation of the Purdue 
Rating Scale for Instructors m which the limitation just mentioned is 
largely absent, since the average instructor is likely to have a hundred 
or more students On this scale students judge instructors anony- 
mously by checking on a graphic scale the amount of ten different 
traits presumably related to success m classroom teaching possessed 

' A paper given before Section I of the AmeTican Assocititiori for tho Advftnce- 
mont of Science, Dec 28, 192C, Dea Momes, In, 

* Remmers, II H,, Shook, N. W,, and Kelly, E. L An Einpiiicai Study of the 
Validity of the Bpearmna-Brown Prophecy Poimuln ns Applied to the Purdue 
Eating Scale Journal of Ediicahonal PsycholoffVy Vol XVIXI, No, 3, March, 1927, 
pp. 187-196 
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by a given teacher undei consideration. In a rating program carried 
out at Purdue University during 1928-1929, something over ninety 
per cent of the faculty weie lated i A number of instructors turned 
over to me their maiked and scored laling blanks The question the 
answer to which was sought was, Do the judgments which students 
recoid conceining their instructora follow the law represented by the 
Spearman-Brown prophecy formula? In other words, is it valid to 
assume that judgments are the equivalent of test items in the sense 
required by the formula? 

The formula, by now rather well known in its application to test 
construction, is 

r = «?’lt 

1 + in - l)nt 

where r„ = the predicted reliability, 

n = the number of times a test is increased by its own length, 
and 

j-i, = the reliability of a unit length of the given test. 

In the present problem the unit is tlic judgment of a single student, 
and the problem is to determine the correspondence of reliability 
coefficients determined for given numbers of such judgments with 
those predicted by the formula. 

If the conditions of the formula weie always fully met, perfect 
piediction would result Piactically, howevei, the conditions are 
never ideally met, and our problem becomes a sampling problem sub- 
ject to the laws of probability 

It should be leoalled that the validity of the foimula depends upon 
the homogeneity of the test items, or, statistically speaking, upon the 
equality of intercoi relations between units and upon the equality of 
the standard deviations of these units 

Procedubb 

In the latings of the instructors used for this investigation there 
was, so far as I know, no selective factor operating in the return of 
these blanks, except that instructois with unusually low latings might 
have hesitated to retuin them as readily as those with more satisfactory 
ratings To the extent tliat such a factor did operate it would tend 
to reduce the variability of the total distribution of latings and thus 
to reduce the reliabilities below what they would otherwise have been 

* Rommeia, H H ; The College Piofessor as the Student Sees Hun Bulletin 
of Purchte Univeisity, Studies in Highei Education, Vol XI, March, 1929, p 83 
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From each instructor's ratings scores were selected according to the 
following schema: 

20 HftmplmgB of 1 fff 1 rating for tt-aib fir PrcBcntatlon of Subjont-mattcr 
6 B&mplings of 6 ratings t®. S 6 TatlngSi for trait 6, l^resentation of Subject' matter 
6 Hampllnge of SlO ratings ufl ^IQ rntinge, far trait 5, PrcBentatSon of Subjoofc-mattor 
6 BamplIofiB of JJlfi ratings pa, £16 rAtinES, far trait 6, PrcBcntation of Subjoot-mattor 
1 Bompling of S20 ratings va £20 ratlngB, for trait 6, PrcBontation of Subjeot-matter 
1 sampling of S3D ratings va £30 ratinge, for trait 6> Prcaontation of Subjoot'matter 

Traita 1 and 10, Interest in Subject-matter and Stimulating Intel- 
lectual Curiosity, and also the sums of all traits, were sampled m 
exactly the same way, except that only ten 1 vs, 1 correlations were 
calculated for these, and that in the case of the sums of all traits the 
samplings obtained included only 1 ws 1, 220 vs. 220, and 230 I's. 230, 

The results of the samplings are shown m Tables I to VII, 

The Data 


Table I -"Distiwrtttion^ of Coiihblation8 1 iisj 1 Rating for the Traits 

Indicated 



In Table VII are summarized the necessary data for answering the 
PToblem raised at the outset of this study, t.e , as to ivhcthcr judgments 
under the defined conditions are equivalent to test items in the sense 
of the Spearman-Brown formula The answer is that they aie. 
There is apparently a slight tendency for the formula to overprechet, 
there being sixteen overpredictions out of a possible seventeen. These 
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apparent overprediotions, however, are probably to be explained by the 
reduction in the number of instructors necessitated by the lack of 
instructors with very large classes This tended to reduce the “range 
of talent, with a corresponding reduction in reliability. In no single 


Taulb II — Correlations of vs 25 Katinqs pou the TR\iTa Indicated 


Trait 1 

Tuut 6 

Trait 10 


863 

783 

016 


700 

782 I 

676 


762 

1 700 

433 


721 

709 

428 


706 

644 

346 

Mean 

728 

736 

470 

Median 

752 

760 

433 

N 

36 

36 

30 


Table IIL — ConnBLATiONS op SIO ^3 210 Ratings for the Traits Indicated 


1 

Trait 1 

Tiait 6 

Trait 10 


843 

890 

861 


.832 

866 

781 


063 

.866 

764 


662 

843 

601 


696 

782 

630 

Mean 

.717 

846 

,717 

Median 

663 

866 

.754 

N 

20 

20 

20 


Table IV — ConnELATioNS op 215 vs 216 Ratings for tub Traits Indicated 


Trait 1 ! 

Trait 6 

Tiait 10 

961 

973 

902 

882 

964 

876 

702 

931 

872 

621 1 

064 

821 

007 

671 

791 

Mean 76 1 

887 

852 

Median 702 

931 

872 

7 

1 " . _ 

' 7 

1 
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Taulb V — CoRUEiiiATioNa OF 220 vs * S20 Ratinos fok the Traits Indicated 


Trait 1 

Tiait 6 

Tiait 10 

Sum of all tiaits 

,801 

877 

036 

898 

N 13 

13 

13 

40 

Taulb Vi,— CorreUations of 230 vs. 

230 Katinos for tub Traits Indicated 

Trait 1 

Trait 6 

Trait 10 

Sum of all traits 

936 

876 

805 

872 

N 10 

10 

10 

10 


casG> however, is the difference between the '^best” or most probable of 
the observed correlations and that of the corresponding predicted 
values clearly statistically significant In the case of only two 
correlations is the diffeicnce divided by its probable crior greater than 
two 

On the face of the data, it seems surprising that the summation of 
all traits should give no higher reliability than was observed This, 
however, is probably to be explained by the fact that the law trait 
scores are incommensurable Had these scores been fiisb reduced to 
standard measures or percentile equivalents, the resulting reliabilities 
would very probably have been increased very mateiially, 

Summahy and Conclusions 

Samplings of judgments for varying numbers of judges selected at 
random yielded reliability correlations within the allowable error when 
the judges arc undergraduate students and the things judged are 
classroom personality traits of instructors who are appieciably different 
in that they possess, in the judgments of students, different amounts 
of these traits^ The number of coirelations upon which this study 
was based is one bundled thiee The following generalizations seem 
warranted from these and previously reported data 

1 Reliabilities are predicted within the allowable error up to 
thirty judgment?; 

2, The three traits sampled in this investigation vary significantly 
in leliabihty Stimulation of Intellectual Curiosity, for example, 
means more different things to students than does the tiait Piesenta- 
tion of Subject-matter, 

3 In general, ratings by from ten to twenty students on a single 
trait for instructors differing sensibly in the amount of the trait pos- 
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No r’e 

No of 

Averngo 

Corrciftiion 

Dili 

PEdm j 

Difl 


Gomputed 

inatruotora 

obaorved 

predicted^ 

PEdlH 


TrnU 6 rrcscntttlion of uubjcct-mnlter 


1 1 
s 6 T8 li 6 

SlO P8 Sic 
Sl5w 21fi 

S20 VB S20 

230 va 130 

20 

5 

6 

1 

1 

37 

(iO 

20 

7 

IJ 

10 

1 

783 ± 061 
878 ± 061 
016r± 007 
036 ± 038 
060 J: 030 

047 

033 

028 

068 

080 

I 

.6 

6 

2 

1 0 

1 4 


1 v$ 1 

10 

37 

36 1± 0D7 





1 D8, £ 5 

6 

ao 

470 ± OSC 

733 ± 080 

264 

122 

2 1 

210 rj 110 

6 

20 

717± 073 

810 ± 077 

I2D 


1 2 

215 2!16 

5 

7 

852 ± 070 



■m 

3 

220 va X20 


13 

D361 111 

015± 055 

270 

121 

2 a 

230 va 230 

H 

10 

806 J. 076 

013± 016 

138 

087 

1 c 


Trail 1 IiitcroBt in Bub^cct^matlcr 


1 rs 1 

10 

37 

200 ± 102 





£ 6 rd £ 5 

* 6 

80 

728 ± 063 



122 

5 

£lOi'S XIO 

6 

20 

717 ± 073 




7 

£15 vd £16 

® i 

7 

7si± no 


100 


0 

220 VB £20 

1 1 

13 

805 ± 000 

801 ± 081 


105 

8 

230 vs 230 

1 

10 

030 ± 020 


.on 

071 

2 


Sums of all traits 


1 »a 1 

10 

37 

320 ± OOO 





£20 w £20 

1 

40 

898 ± 021 

004 ± 038 

000 

043 

1 

£30 tra £30 

1 

10 

872 ± OlOl 

933 ± 043 

001 

' 060 

1 

1,0 


^ Tbcao r'fl were caloulntcd by mcoriB of Siicn'e formula, PE* = — 

yN[l + (o - l)r]* 

nrticlo, A Note on Uio Standnid Error of the Spearman-Brown Formula Journal of Sducatxonal 


Pmholoou, Vol XVII, 1026, pp 03-04, also Douglas, Ilarl A , A Noto on tho Gorrootnesa of Certain 
Error Formulaa Journal of Educational Psifcholooi/, Vol XX, 1020, pp 434—437 


sessed yield leliabilities which compare rather favorably with the 
reliabilities reported for standardized mental and educational 
tests 

4, It IS piobable that in the majority of situations in which sub- 
jective judgments are used — personnel ratings, stock judging, debate 
judging, beauty contests, juiy verdicts, political polls, etc. the 
Spearman-Brown piophccy foimula indicates the number of j udgments 
required for a given reliability, although here it must be admitted that 
we are going beyond the known facts 





















SEMI-IOGARITHMIC VERSUS LINEAR PLOTTING 
OF LEARNING CURVES 

EICIIARD W. HUSBAND 
Univeisity of Wiacojism 

The usual melhods of plotting learning curves, say of tunc or of 
errors, using linear functions in both variables, have cci lain limitations 

1. The actual shape of the carve will vaiy considerably Avith differ- 
ent spatial separation of successive units If the spread is wide, the 
whole curve will he rounded out, approaching the so-called “typical 
concavity.” If it is small, the cuive will be flattened out neai the 
base line 

2. The unit gains tend to be artificial, and dopendent on the arbi- 
trary intervals chosen. Reduction from ten to nine errois is not 
nearly as important or as difficult to accomplish as fiom two to one 
or from one to zero, yet on a linear diagiam the two appeal equal 

3 A further difficulty lies iu making objective and decisive 
comparisons between curves Aside from thcoietical and technical 
interest, the chief functions of quantitative expeiimenlation, including 
the subsequent statistical treatment, arc to compare the relative 
performances or cfflciencios of different groups or techniques Exam- 
ples arc such questions as two different spaemgs of learning periods, 
dietary or drug conditions, or comparisons between several species. 

Just as Thorndike and Koffka interpret stupidity and insight 
respectively from the same curves, so may two investigators lead 
clear superiority and negligible differences fiom a single set of com- 
parative curves. The same ambiguity is present in comparing means 
unless we use probability figuies deiived from the standard erior 
of the diffeience between the means. With linear plotting we do 
not have available any single figure to use in expiessing entirely apart 
from poisonal opinion the differences between performances m learn- 
ing, especially considering that we are dealing with ft continuous 
tempoial senes. We are more or less limited to cdrauing the cuives 
from an aesthetic standpoint, and passing a few judgments fiom 
inspection 

Occasionally an ambitious investigator has attempted to tit the 
cuives he has obtained to an equation, in ordoi to express the progicss 
of learning in a single figure or m ft single function This is all veiy 
well, but such equations are usually highly specialized, and are only 
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giiitable foi Lho single set of data. They often involve advanced 
mathematics, not an avnilnblc tool to all expciimcnters; use logarithms, 
trigonometry, or calculus, and difficuU-to-dotcrmine constants of only 
individual application 

All these difficulties melt away at once if one plots the same data 
on semidogarithmic paper. The horizontal axis or abscissa is used 
for successive trials, as usual, and is kept on a linear basis, as each 
trial IS by natuio equally separated from all otheis. The vertical axis, 
or ordinate, is scaled logaritlimically, and the score under considera- 
tion, eirors, time, or units done, as the case may be, is plotted on this 
In some cases, owing to the manner in which the paper is punted, 
the original scores will have to be converted into percentages, say of 
initial or of final peifoimance Tina, however, is no seuous handicap^ 
as the onginal unit scoies may be wiittcn on the axis as well No 
knowledge of logarithms is needed; plotting is done as directly aa 
when lineal paper is used The giaph paper itself takes caie of 
this function 



Cbabt I — ^Linear lofiriiing ourvea (Orchnato) avoiugo number of errors. (Abscisaft) 

trial. 

Tins proceduxe disposes of the difficulties wo have laised as follows; 
As to the fiist, the shape of the cuive, theie will be no diffeience, no 
matter how it is plotted, Regulaily progressive learning will invari- 
ably result in a straight line. The second objection is disposed of, 
as the fundamental piinciplo of logaiithms is proportion rather than 
absolutes. On this basis equal propoitional gams are represented 
equally, no matter at what point in the learning process. Thus, 
reduction from eight to four errors does not show up as any greater than 
does later impiovcment from four to two, oi from two to one Thoie- 
fore, if an individual learns a constant fi action of the material on each 
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trial the successive points will make a etiaight line when connected 
together. This leads us directly to solution of the third defect of the 
former method, that of objective comparisons between cuives If 
the two or more curves under consideration take practically stiaight 
lines, we can compare progress made by the various groups by quoting 



CHA.HT II — SoiQi-logatxtUmL'O loam mg curves (Ordmato) average number q£ orrorB, 

(AbBciQsa) tnai 


the number of trials required by each to reduce by half the error or 
time score, or to double the output, 

We include learning curves drawn from the same data by the 
two methods. The data were obtained by the wiitcr fiom a group 
of eighty subjects who learned a maze of moderate difficulty. In 
both cases the solid line represents the figuvesfor the full group (eighty), 
the broken line those (twenty-seven) in the group who learned by a 
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purely ideational method, and the line made up of a dash and two 
dots the motor learners (fifteen). The data were smoothed by a 
moving average of three trials, in order to reduce minor fluctuations. 
This in no way makes any difference in the comparisons, since both 
sets of curves weie ticatcd alike The straight lines drawn m the 
logarithmic data are only approximate, it must be admitted, but 
the deviations of the individual points are seem to bo remarkably 
small. 

Let us now give sample interpretations of the two sets of curves. 

(A) Linear Method. — (1) All groups start at about the same 
level, (2) The motor learneis soon aie at a disadvantage, while those 
using nn ideational attack do bettei than average (3) The differences 
appear to widen up to about the tenth tnal, after which thcie is 
doubt 

(J5) Logarithmic Method — (1) and (2) the same as under (A) 
(3) The absolute diffeiences, as well as relative, are constantly wid- 
ening, and as fai as the twentieth trial there is no tendency to narrow 
down. (4) Learning, m this problem at least, is characterized by a 
proportionate reduction of errors, which shows up in this chart 
as a straight line (5) Judging by reduction of errors from six to three 
(or any other arbitrary limits) the average individual halves his 
inaccuracies m 6^ trials, the ideational learner in and the motor 
learnei in fourteen attempts 

Do not these last figuica alone mean much more than any amount 
of verbal discussion, de.scnption, and estimate? In other words, 
wo lose nothing but gain a gicat deal. Yet no complicated mathe- 
matics is needed in order to make one’s interpretations and compari- 
sons, All m all, plotting data on a logarithmic basis gives us clearly 
objective and concise ways of mlcipi’eting data 

The writer does not claim that all learning curves will form a 
straight line if plotted this way But m trying sixteen different sets 
of figures from maze learning lecords, there was not one in which the 
points did not hover within the normal variability limits of a frequency 
on either side of the lines which weie diawn. Slight curvilinearity 
would not stand in the way of inteipretations on the basis we have 
described. 



NEV PUBLICATIONS IN EDUCATIONAL 
PSYCHOLOGY AND RELATED FIELDS OP 
EDUCATION 

CONDUCTED BY FRANCES M. FOSTER 


Fundamentals of Educational Psychology, by I M, Gast and H. C 

SkinnGi’ New Yovk. Benj H Sanboin and Co , 1929. Pp. 

XIII + 364 

Changing viewpoints in educational psychology necessitate fresh 
treatments of the subject The mm of the authors of the piosent 
volume has been to relate the subject moie closely to classroom 
practice, to include the social and applied aspects, and to present the 
best of new opinion and evidence of new movements in education and 
psychology. Then account is expressed m terminology that the 
average student can understand, uncomplicated by highly technical 
details. Educational applications arc made for every topic discussed, 
The most recent reliably determined evidence in support of statements 
is consistently referred to The authors state that they have not 
attempted to present a “logical system of psychology " They have 
gleaned from a wide variety of sources and from varied schools of 
psychology explanations of phenomena which appear to them to be 
most authentic. The result is a presentation of the subject that 
contains much of the older mateiial, the more famihai topics one is 
accustomed to seeing in a standard text, togethei with new points 
of view and an occasional new chapter, “ Mental Health " “ Childhood 
and Adolescence,” “The Gifted Child,” “Nature and Nurtuie,” 
“ Intelligence — Its Nature and Measurement,” “Educational Measure- 
ments.” A list of the psychologists who have contributed most to 
education is given, and a unique feature of the book is the inclusion 
of their photographs Questions and pioblems for fmther study, a 
list of references cited in the text, and suggested readings follow each 
chapter 

The authors have avoided critical discussion of divei gent opinions 
and antagonistic theories of different schools of psychology The 
newer inteipretations of gestalt psychology are scarcely mentioned 
Description of the physiological bases of behavior has been limited 

76 



Nm Publications 


77 


to a few of the most essential facts which arc stated m the introductory 
chapter The authors appear to be committed to a "'conditioned 
reflex” interpretation of learning, although the discussion is not at 
all times consistent. Their explanations of learning, habit formation, 
and skill impresses the rradcr as being the least commendable of all 
the topics discussed The educational applications contain many 
excellent ideas which might well have been expanded oi more fully 
explained Too often they arc in the form of advice which is not 
closely related to the psychological principles presented and not 
pertinent to the subject discussed The result is occasional lack of 
coherence These defects are minor and do not detract from the 
usefulness of the book as a source of material for the student of educa- 
tional psychology. Gertrude Hildreth. 

The Lincoln School of Teachers College, 


Slud%cs tn The Orgamzahoti of Character j by Hugh Hartshorne, Mark 
A May, and Frank K. Shuttleworth New York , The Macmillan 
Co Pp. 603 

This volume brings to a close the work of the "Character Education 
Inquiry,” It follows "Studies in Deceit” and "Studies in Service 
and Self-control,” and is in many respects the most important volume 
of the three. It contains the following parts* 1. Social Intelligence 
and Social Attitude; II Interrelations of the Factors of Character; 
HI, Components of Character; IV. The Significance of Integration ; 
V Conclusions of the Chai actor Education Inquiry, 

Those who have followed the work of the "Character Education 
Inquiry” will recall that the investigation showed that deception, 
helpfulness, cooperation, persistence, and inhibition weie groups of 
specific habits, rather than general traits. "One could hardly predict 
from what a person did m one situation what he would do in a different 
situation ” Theie are, however, obvious differences in individuals 
in the degree to which then behavior is of a consistent pattein. It is 
chiefly with the study of this inner consistency that this volume is 
concerned 

To eight hundiod fifty children m the fifth to eighth grades of three 
school groups (or composites) weie given a large battery of tests, 
including tests of moral knowledge and attitudes, tests of deception, 
of cooperation, of inhibition, of persistence, of suggestibility, of 
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"neivous inatabjhty,” and vaiions rating schemes, for determining 
"level of social functioning/’ reputation, and the like Measures of 
intelligence and home background were also available 

The coirelations between the vauous objective tests, even when 
corrected for attenvation, showed little relationship between gross trait 
scores. For example, honesty correlates with sciviee 439, with 
inhibition .487, with peisistcnce ,166, "This mciiger consistency m 
behavior of good or socially desirable types may scctn lamentable, 
but wo shall have to conclude that consistency ns not characteristic 
of children . . Wo cannot infer fiom the conduct tests the presence 
of a general factor." 

The effect of group standards on conduct was investigated, and 
while there was little relationship between an individual’s ethloal 
understanding and his conduct (aside fiom the relationship existing 
through intelligence), there were dchuito relationships (aside from 
intelligence) between knowledges of right and wioiig and actual 
conduct when classroom groups were considered as a whole 

Probably the most immediately valuable part of this report is that 
dealing in a very detailed manner with the integration of honesty. 
Other of the charactei traits might have been investigated, but the 
honesty tests were used since they weie the most comprehensive 
battery available It will be remembered that the mtercorrclation 
between the various honesty testa was very low, leading necessarily 
to the doctrine of specificity of reaction in this field. Now if the 
scores of a child in each test be distributed, and a measure of dispersion 
computed, we have a measure of the degree to which the child tends 
to he consistent in his behavior — be it honest or dishonest Twenty- 
one tests were used For each child the SD of his scores was computed 
This IS called his index of integration Thus a perfectly honest 
(or dishonest, or 50 per cent honest) child would have an index of 
0.00. When the unreliability of the tests used was compensated for, 
there still remain large differences in integration These integration 
indices wore correlated with total honesty score The correlation, 
corrected for attenuation, is about 80, This means that the moie 
honest a child is the more consistent i3 he in his honesty. The possi- 
bility that this icsult is an artefact of the nature of the testing set-up 
IS interestingly and fairly discussed, pro and eon. It is concluded that 
In so far as the test situation is responsible for the ooi relation, it is 
nob arbiftoial in that the same factors which make the more honest 
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children more consistent in their tost results also are operative in the 
life situations calling for honesty 

The implications of the above arc interesting Although moral 
conducl IS, m the main, largely specific, it is shown that as conduct is 
improved there lesults a general impiovcmcnt It is the behavior 
of the dishonest child which can be moat readily modified 

It IS difficult adequately to appraise a study so vast in its scope 
as this work It is ceitain, however, that this Inquiry is of leally 
tremendous importance to education. And the present volume is 
easily the most interesting and valuable to the non^research person 
m the educational field, Donald Snbdden 

New York Univoisity. 


Ueseaich Methods and Teachers^ Piohlems^ by Douglas Waples and 
Ralph W, Tyler. A Manual for Systematic Studies of Clasaroom 
Procedure, New York. The Macmillan Co, 1930 Pp, XXIII 
+ 653. 

The solution of administrative and instructional problems by 
research methods la an important aspect of modern educational 
practice The research worker now has at his disposal a group of 
publications describing research technique to which the present 
book, designed as a text for teachers, administrators and technicians 
IS an important addition, Ecsearoh is interpreted by the authois' 
in a broad sense as including not only laboratory experimentation but 
the study of service pioblcms such as the teacher or administrator 
meets m operating a school, The authors, however, distinguish 
between these two types of research, pointing out the narrower scope 
and more intensive approach in laboratory studies Such a problem 
as testing and classifying a group of pupils is considered research 
though distinguished from laboratory experiments m measurement 
and classification 

The authois have devised a working plan for leseaich projects in 
general, divided into several major steps The types of data needed 
for typical problems are listed, available souices of data are 
enumerated, and methods of obtaining data from available sources are 
outlined The research problems commonly met by educators are 
classified m thioc groups, problems of the curriculum, of teaching 
methods, and of school management. For each of these three classifi- 
cations appropriate methods of attack are outlined and illustrative 
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studies are presented in outline form A list of sixteen different 
techniques or methods of approach with an evaluation and description 
of the method of applying each concludes the book Adequate 
bibliographies are provided at the close of major topics 

No book on lesearch methods can of itself produce experts in 
educational research, just as the expert cook is not necessarily the 
product of a cook book, but just as the cook’s technique impioves with 
training in method, ao may the research student improve hia experi- 
ments with increased training in technique, To follow any tioatise 
on research methods slavishly would be to defeat the voiy purpose of 
research. In using the book under discussion some students may be 
inclined to accept too readily the interpretations of the authors and the 
carefully detailed outlines without exercising originality or independ- 
ence of judgment. When the outlined pattern fails to fit, the student 
must be resourceful and intelligent enough to alter or adapt it. The 
authors unfortunately give no discussion of the use of research m 
modernizing educational methods, Gerthijde HiLURETn. 

The Lincoln School of Teachers College. 
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PRACTICE VERSUS GRAMMAR IN THE LEARNING OF 
CORRECT ENGLISH USAGES 

PERCIVAL M 8YMONDS 

Tcachei’s College, Columbia University 

Recent correlation studies have shown little relationship between 
knowledge of English giammar on the one hand, and the correctness 
of usage on the other Those who aie familiar with these studies 
commonly believe that tho value of English grammar m influencing 
correct giammatieal usage in speaking or writing has been definitely 
discredited. But correlation studies have frequently misled in the 
past regarding tho actual dynamic relationships in learning and the 
amount of tiansfer that can bo expected. Grammar still has a some- 
what thriving existence m our schools 

In 1906 Hoyt® reported a correlation os low as 18 between grammar 
and composition ability among high school pupils. Rapeei^ reports 
the same lelationship to be 23. Segal and Bari'' in a minor study 
reported a correlation of 48 between a test of formal grammar and a 
test of "applied giammar” which is really a test of ability to choose 
the coirect form. Asker^ reached similar conclusions by a dift'eient 

‘ The autlioi is indebted to Mi. Ficdcrick Gmham, foimcily principal of P. S 
210 Biooklyn, Mi Jacob Theobold, principal of P S. 165 Manhattan, Mr Abra- 
ham Ehrenfold, principal of P S 10 Manhattan, and Mis Ruth D SchattelGs, 
formerly piincipal of P S 87 Manhattan, for thoir moat helpful cooperation m thia 
experiment, and to tho many teachers who pai ticlpatcd 

“Hoyt, F S. . "The Place of Grammar in tho Elementary Curriculum" 
Teachers College Record, Vol VII, Novembet, 1906, pp. 467-600 

* Rapeer, L W : "Tho Problem of Foimal Grommar m Elemental y Education " 
Joanial of Educational Psychology, Vol IV, Mnieh, 1913, pp 126-137 

Sega, D , and Bair, N R "Relation of Achievement m Formal Graminai to 
Aoliiovcmont in Applied Grammar ’’ Journal of Educational Research, Vol XIV, 
December, 1920, pp 401-402 

‘Aaker, W' “Does Knowledge of Foiinal Grammar Function?" School and 
SocxcUj, Vol XVII, Jamiaiy 27, 1023, pp 109-111. 
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method. The geneial conclusion reached from these correlation 
studies, to quote Segal and Barr, is that "foiinal grammar has no 
immediate tiansfcr value so far as applied English giammar is 
concerned.” 

However, the tiue test is the experimental test. What leal 
influence does learning English grammar have on usage? To deter- 
mine what influence exists, the wntor caincd out some Icst-teach-test 
experiments in Grade VI of four New Yoik City elcmentaiy schools 

The tost winch was used m the experiment consisted of forty items 
and was modeled after the Charters Diagnostic Language Tests 
Each item (except the fiist) consisted of a sentenco having a gtam- 
matioal ciroi to be conected by the pupil by rewriting the sentence 
in the space beneath the item Samples of the items are . 

14 Arc you most ready to go ? 

28. He Bftwl that I was most there. 

Previous experience with the Charters test indicated that the 
lowest initial scores, and consequently those items of greater difliculty, 
were made on adjectives, adverbs, prepositions, and conjunctions. 
Consequently in planning for this experiment all of the items selected 
for this test were of these types. This test was called Test I, and was 
always given first as well as last m the experiment, with the hope of 
discovering what changes took place on the tcstfduc to the activities 
earned on m between 

The technique of the Charters test was ictamod as the best simple 
measurable evidence of usage It would have been possible to have 
made the test a tiuer measure of choice in an uncontrolled situation, 
but probably at sacrifice of scoi ability and reliability On the other 
hand in using a recognition test, pupils would have been moie keenly 
attentive to dift’erenccs in form and it would have too narrowly a test 
situation and not enough an opportunity to vecogniise spontaneously 
when a form is incorrect and what the correct usage should be 

In every case Test I was immediately repented at the opening of the 
expeiiraent, and all gams wcie computed from the second application 
of the test instead of the first in ordei to eliminate the influence of 
practice on the test The average practice effect was found to be 1 14 

Six different experimental procedures were tried. Each procedure 
was conducted in thieo classes in a different school under very caiefully 
controlled conditions It was behoved that m concentrating a pro- 
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OBClurc wilihvii a scbool thcrG was less danger of having ieaohers discuss 
what they were doing and honce vary their procedure from that which 
was defined for them No attempt was made to equate groups except 
the rough one of choosing Grade VI groups This defect in experi- 
mental procedure is recognized. The possible influence which dif- 
ferences in. selection in tho groups might have on the results and 
attempts to allow for possible difforences will be disoussed It would 
have been possible to carry out the study on the scale contemplated 
if tho orthodox equating techniques had been followed. 


Experimental Phocbdurb I: Repetition or Correct Forms 

Four classes in each of two schools, P, S. 10 Manhattan and P S 
210, carried out the cxpeiimonb in pine repetition m 1929. Sheets 
were prepared which contained forty sentences each of which were 
grammatically correct. Each sentence contained a usage which 
which coTiespondcd to a similar incorrect usage m Test I. Examples 
of items in this sheet of correct sentences (Exercise A) are as follows 

14 Tho boy was almost killed by an automobile* 

28 My baby brother is ahnosb two years old 

Exorciso A was distribuLed to each child and directions to the * 
teacher stated. 

Have the class icad tliiougli tho aontonces aloud and iti unison. Lefc the 
teachoi first read tho ntimboi of tlie item and then the class read the sentence, 
Do not let tho ehildien huny See that they read slowly and distinctly. See 
that everyone leads Do not allow tho class to repeat any of tho aentonGes 
unneceaannly K tho class leada a sentence incorrectly or mispronDuncea a word* 
liavo them repeat it (once) correctly 

The sheets weie unmocliatoly collected when this reading was 
finished This device made possible one repetition of each correct 
form by each child 

In order to check up on the influences of different amounts of 
practice on this new test (Test I) as compared with one previous experi- 
ment, one vefekiton of ExcroiBO A was given between the two applica- 
tions of Test I m I wo classos, three repcUlioiis between tests m two 
classes; yjye repehiionf^ in Lwo classcn; and ten repehtions in two classes. 

This part of the exporunent was dGsigncd to give a measure of the 
influence of sheer lepetition with which the results of othei experi- 
mental procedures could be compai eel 
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EXTERlMENTAIi PROdEDUUB II: REPETITION OF COTIRECT AND 
Inooukect Forms 

Id this BecUon of the experiment caivied out in P S 165 Manhattan 
in 1929, mere repetition was again studied, but in this case both the 
correct and incoriect foms were repeated , side by side This new 
exercise (Exercise A, Emm 2) was distributed to the children with 
directions that it be read aloud and in unison as a class as in the pre- 
vious procedure. Three icpetitions of this oxeicise weie interpolated 
between the tests and the results were comparable to the three repeti- 
tions used in the first experimental proceduie 

Examples horn Exeicise A, Eorm 2: 

14» Thoboy waa moat killed by an ftuto- 14 Tho boy waa^ almost killed by atv 

mobile automobile 

13 wrong 18 right. 

28, My baby bi other la most two years 28 My baby bioihor is almost two 

old yeaia old 

18 wiong is right, 

The pupils road ^s wiong or is nght after each sentence 

Experimental Progedube III* Knoweedge of Definitions, 
Rules, and Principles and Grammar 

In this section, carried out in P, S 87 Manhattan m 1929, an 
attempt was made to determine tho mfluonce on usage (Test I) of 
more learning of grammatical rules and principles A grammar study 
guide was prepared containing definitions, lules, and principles which 
applied specifically to the errois in Teat I. 

It was an original intention to include m this first edition of the 
grammar guide only bare definitions and rules with no illustra- 
tions. But this seemed such a formal procedure for eliildron in a class- 
room even in an experiment and so far removed from school procedure 
that illustrations were included This experiment does not tell us 
how much the illustrations in illuinmaiing the rules influenced the 
results. 

Teachers were cautioned as follows: 

Do not do any of the following 

Do not ask pupils to maka up examples of thou own illuatiabing tho 
rules, 

Do not give the pupils additional oxtimplea of the rules. 

Do not ask pupils to analyze the rules 

Do not give the pupils practice in applying tiny of tho rules 
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The three teticheis cooperating m the experiment wei e instructed 
to drill their pupils m memorizing tho definitions, rules and principles 
so far as tune permitted. Fifteen or twenty minutes a day foi two 
weeks or more wore used 

A sample of the grammar guide, as it applies to the particular 
items alieady given fiom the test, is given below 

Most and almost nro often confused, Afosl is au adjective and should modify a 
noun 

Example Moil boats cairy life piesorvcrs 
Almost is nn adverb and should modify a verb 
Example John has almost finished his work. 

A sheet of “Questions on Rules for Coriect Usage of Adjectives, 
Adverbs, and Conjunctions” was also supplied to each child 
Illustrations of items aie: 

22 VVliat part of speech is moslf 
23. Wlint part of spooeh is almost? 

The teachers wore instructed to use these sheets with the pupils 
m drilling them on these definitions, etc 

Finally a “Test of Knowledge of Rules for Coireci Use of Adjec- 
tives, Adverbs, Piepositions, and Conjunctions'' was prepared This 
was to be given to the class after tho study of the grammar was finished, 
but before final Test I 

Samples of items on this test on grammar rules are 

22 Most 18 an (1) adjective, (2)advcil3, (3) proposition, (4) oonjuaetion. ( ) 
23. Alnaoat la an (1) odjoctivo, (2) advoib, (3) proposition, (4) coiijunotion 
( ) 

The teachers were given the express goal of preparing their pupils 
for this test on grammar rules, using every means at their command, 
direct or indirect They were to aim at one hundred per cent on the 
grammai lules test if possible and the extent to which they reached 
this goal was a measure of then success in teaching the grammar 
rules. That they wcie remarkably successful in this is evidenced 
by the fact that out of a total possible scoic of 36 on this test, the three 
classes averaged 33 1, 24 2, and 30.1, 

The puipoBC of this woik was to discover what influence the learn- 
ing of the rules had on Test I 

Experimental PitociomniB IV' Gbammab Analysis 

The fouith experiment was cairied out in one class in P, S 87 
Manhattan and two classes in P S 210 Biooklyn in 1930 In this 



86 


The Journal of Educahonal Psychology 


pait of the experiment the value of ability in the grammatical analysis 
of sentences in improving English usage was studied. Experiment IV 
went one step further than Experiment III and gave pupils practice 
in analyzing the grammatical construction of ceitain words and 
phrases A new grammai guide was made which included not 
only the definitions, piinciplcs and lules as bcfoie, but also certain 
exeiciscs in which pupils were expected to recognize and name the con- 
struction In Experiment IV teachers wcie instructed not to do any 
of the following: 

Do not have the pupila raemorizo or leain the lulca or pimciplos 
Do not give examples of or cmphaaize tlie lorong foim in any of the excroisea 
Do not give the pupils practico m applying any of tho rules 
Do not have tlic childicn make up ilhiatrations of then own. 

Eveiy thing should conccntiate on having ohildrcn learn to analyze the sen- 
tences given 

Besides the definitions and examples m the grammar manual 
which are similar to those used in the previous expeiiment exeioises 
were included of which the following are typical: 

1 boats carry life presoivois / Most is an 

and modifies 

2 John has almost hniBhed his work Almost is an ^ 

and modifies . 

A test of thirty-foul items with a total possible scoie of sixty-one on 
Grammar Analysis^' was prepaied and the teachers cooperating 
m this experiment were instructed to do everything possible to prepare 
their pupils to do well on this test. Their success is evidenced by 
average scores of 37.9j 42 6, and 42 8. 


Experimentai/ Procedure V. Choice of Correct Constructions 

Experiment V, which was conducted in P S. 10 Manhattan m 
1930, tested the value of practice in choosing correct constructions on 
English usage as measured by Test I 

A new grammar guide was again piepared including not only tho 
necessary definitions, principles, rules, and illustrations, but also 
exercises in which pupils were given practice in choosing correct 
constructions Samples of these exeicises on the same distinction 
most and almost are* 
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Exercises on Use of Most and Almost — ^Inseit most oi almost in the following 
blank spacca' 

1 Are you over your cold? 

2, birds build neats 

3 Which IS tho fun? 

Ill this oxp 0 iiment the teachers were instructed to Jimit their 
teaching strictly to giving the pupils practice m choosing the correct 
constructions. They weie told not to have tho pupils memorize or 
learn lules oi piinciples, not to give examples or emphasize the wrong 
form in any of the exercises, not to analyze the constiucUons in any of 
the examples or exercises, and not to have the children make up illus- 
trations of their own 

As before, a test was prepared on the choice of coriect constructions 
and teachers were expected to help prepare their pupils directly for 
this test. Items in the test were of the same kind as the practice 
exercises, illustrations of which have already been given. The success 
of the teaching may be seen from average scores of three classes The 
scoies were 24.3, 24 4^ and 26 7 out of a possible 33. 

In this procedure, as in the other, Test I was given first and last, 
the aim being to see what effect the practice in choosing correct con- 
structions has on Test I. 

Exfebimental Pboobduiie VI j Whole Pbogbam 

In 1930 the whole program comprised in the previous experiments 
was tried out in P S. 16S Manhattan After Test I, the grammar 
manual was distributed and pupils in thiee Grade VI classes learned 
the various definitions, principles, and rules, piactioed analyzing sen- 
tences for the constructions of certain woids, and practiced choosing 
correct constructions. When all this was done tests wore taken on 
knowledge of grammai rules, ability to analyze certain constructions, 
and ability to choose correct foims This was capped by three 
repetitions of the right- wrong foims of Exercise A, Form 2, described m 
Procedure II Then Test I was repeated. The average scores on the 
tests for three classes were as follows 
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TAULli] I — AVEluaE »ScOIlE3 ON KNOWLEDGE, ANALYSIS AND ClIOICE TdsTS GivBK 
TO These ClAvSses in Piioceduhe VI 



Knowlcclgo 

tost 

Analysis 

test 

ChoLco test 

1 

Total possiblo sicois 

36 

61 ' 

33 

Class VIA 

34 2 

56 4 

31 4 

Class VIBi 

30 0 

46 8 

27 6 

Class VIB, 

30 1 

33 1 

26 7 


Table Jl — b'couEs Made on Test I befoue and after an TSkperimentil 

PuOCEDDttE TOQBTUEU 'SVlTtt GaINS EY GlasSES A'ND Aver age GAiNJi 


Expcninentnl Pio- 
cediiio t 
practice 

One 

lopotition 

Tin CO 
lopctiUons 

Five 

lopctitions 

Ten 

icpctitions 


P S 

P. s 

P s 

PS 

P s 

P S 

P s. 

P S 


10 



210 




210 


VIA, 

1 VIB^u' 

1 1 

1 VIAi 1 

1 ( 

VIAi 

1 

1 VIB 4 

YIB, ' 

1 i 

1 VIB, 

1 1 

VIA, 

Secoutl tost 

5 SO 

16 87 

10 41 


8 33 

22,46 

1 0 48 

7 59 

Eirst test 


15 55 

9 22 

12 24 

7 01| 



7 71 

Gain 

+ 40 

4 - 32 

+1 22 

^ 65 

4-1 29 

i+1 70 

4- 78 

^ 12 

Average 

+ 36 

+ 31 


50 

4- 

33 


Expcmwcntal Pioccduie II, puictice ou light 
find wrong, P, S 105 

VIB, 

1 

VIBj 

1 VIBj 

Second lost 

21 77 

21.70 

24 48 

Fnsl lest 

15 00 

12 26 

13 30 

Gain 

AvQingG gain 10 11 

4- 2 7 7 

4- 9 14 

4-U 12 


Expcumeiital Pioccduio IH, leaiiimg lulcs, 

P S, 187 

VIBi 

ViBa 

VIIA, 

Second test 

26 M 

1 13 37 

23 SO 

Fnst test 



17 IS 

Gam 

1 

8 24 

1 

3 11 

6,32 

^rnenn uain 

Average gam ,6,89 

82 

73 

75 
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Tad LB II —Continued 


Experimental Ihoccdure IV, nnalynis, P S 

P S 87 

P S 210 

P s, 210 

87 and P S 210 

VIB 

VIB 4 R 

VlBm 

Second test ' 

23 90 

10 28 

16 02 

Pirsb test 

le S 3 

11 00 

12 23 

Gam . 

4 07 

5 28 

2 79 

c^moau sain 1 

Aveiago gain 4 OB 

84 

B9 

59 


Expenm on tal Pi ocecluro V, choice, P S 10 


VIB, 

VIB* 

Second test ! 

BHumppiii 

17 n 

18 40 

Pirat test 


10 16 

11 68 

Gam 

9 65 

7 66 

0 82 

(T mD^Q sain 

AvQiagG gam 8 01 

66 

03 

98 


Expeiimentnl Piocecluio VI, total program, 

P S 1G6 

VIAi 

VIB, 

VIB* 

Second test 
First test 


29 40 

13 46 

28 72 

16 03 

26 20 

14 72 

Gain 

(’’thobd cnln 

Average gam 

13 37 

15 96 

76 

12 60 

71 

11 48 

86 


Before discussing the significftnce of the lesults consideration must 
be given to possible extraneous faotois which may have influenced the 
results The groups weie not equated, as was previously mentioned, 
except by the rough method of selecting Giade VI classes (one class 
was a VIIA section) It may be seen by inspecting the average 
scores on the fiist test in the above table that there are wide differences 
in initial language usage It is possible that there are also differences 
in geneial ability, and it is conccnsible that the' brighter classes might 
gam so much more from the experimental pioceduie than duller classes 
by Viitue of their brightness as to invalidate the apparent differences. 

These possibilities weie investigated by finding the coiielations 
which exist between vaiious factors. 
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TaDI/K III — COHPFICIKNTS OP COliUEIiATION DBTWEDN MbOTAL AqB, IQ, IkiTIAL 

ScoruB ON Td3T I ANP Gain on Tpst I 



Initial 

score- 

gam 

MA- 
1 initial 
j score 

IQ- 

’ initial 

1 score 

MA- 

gam 

IQ- 

gam 

Experimental Proocdiirc III (ruZe^) (avciagc 






three cIrbsos) 



+ 072 


+ 084 

Experimental Proeccluic IV (analysis) 






(Average three classes) 



+ 330 


4^ 167 

(Average two classes) i 


+ 301 


-h 076 


Experimental ProccdvvieV (c^ioicc) (one class)! 



+ 41S 


+ 162 

Expel imontal Piocedme III (rules) 






(Average three classes) 

- 135 





(Analysxs) IV (avcinge three classes) 

-.271 





(Choice) V (average three classes) 

- 440 





(Total) VI (aveinge thiee classes) 

- 334 





Aveiage 

- 296 





Con elation for total group 

-.138 






These correlations indicate that tlieie is a marked negative correla- 
tion between initial score on Test I and gain on the test In other 
words pupils, making the lowest initial scores on the test make the 
greatest gam, This is probably an artifact of the test. Pupils with 
the higher scores do not have room enough on the tost to make as great 
gains as those malung lower scoies, That this factor had no appreci- 
able effect on the average gains hy classes is seen fioin the following 
table If this factor did influence average gains by classes, then the 


Table lY, — AvBnAQB Initial Scoiib and AvnnAGB Gain for Eaoii of the 
Experimental pROCEDUREb 


School 

Experimental pioccdiires 

Average 

initial 

acoro 

Avoxage 

gam 

1 


One lepotition 

10 48 

+ 30 

P. S 10., \ 


Three repetitions 

10 73 

+ 34 

P S. 210, , , / 


Pivo lepctitiona 

13 89 

+ 1 60 


1 

Ten repetitions 

6 71 

H- 33 

P S, 166 

Practice^ Bight and wrong 

13 54 

+10.11 

P S. 87 

Riilea 


14 05 

-1- 6 89 

P. S 87 and P. S 210 

Analysis 


14 36 1 

+ 4 06 

P S 10 , 

Choice 


12,08 1 

+ 8 01 

P S 166 

Total program 

14 73 

+13 37 



Practice versus Giammar 


91 


differences are leally greatei than they appear, for in this table there is 
a tendency foi those classes with the highest initial average score 
to make the most gain. 

There is also a mnrlcod correlation between intelligence and initial 
score in Teat I. The brighter pupils tend to exhibit better language 
usage as measuied by Test I. The correlation of gain and intelligence 
is negligible although it tends to be positive, Were it not for the arti- 
fact of the negative coi relation between initial scoio and gam it is 
probable that the correlation between intelligence and gam would be 
much lavgci Semi-partial coiielations were computed between gain 
and IQ, eliminating initial score from gam,* showing that the coircla- 
tion between gam and IQ is lower than it would otherwise be due to 
the nature of the test 


Tjuuia V — Semi-vartiau ConnEUATioNs between Gaim and IQ Eliminatinq 
Initial Score from Gain 


School 

Class 


Correlation IQ-gam with 
initial score ehimnated 
fiom gam 

P. S 87 . 

VIBi 

-.337 

-h 061 


VIB, 

+ 67c 

■f .633 


VIIA, 

- 030 

-h 168 

P S 87 

VIB 

-h.379 

H- 419 

P S 210 

VIB4« 

- 046 

+ 236 


VIBw 

-(-.137 

-f 163 


The influence of general ability of a group may have had some 
influence on the gams, but probably .not much. The coiTelation|i8 
positive but low The classes in P S. 166 had high IQ's on the average 
and in both oases made the highest gains On the other hand both 


* By a somi-paitial coirolntion is meant the cbmination of the eReet of a third 
variable from one of the variables In this case the foinmla used was 


ri» — rijfss 

•<-)* = 

where 

1 =* gam 

2 = Initial SCOIO 

3 - IQ 

Somi-partml coelUciontg of coi relation were fii'st developed by Fianaen See 
Fianzen^ H A Comment on Paitial Coirelation Journal oj BJiicational F^y- 
chology, Vol XIX, 192S, pp 19^197. 
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of the classes m P. S. 210 pnriicipalmg in Experimcnial Procediue IV 
(analysis) were rapid advancemcni classes with high IQ^s but they 
made comparatively low gains Again the classes m P. S, 10 partici- 
pating in Experimental Procedure V (choice) had average IQ^s which 
wcic really low m this expenmonl and yet their gains woie high. It is 
not believed that the fact that classes diifeicd in initial ability had 
appreciable influence on the results, 

Intidiipeotation of Tine HnsuLTS 

L The results show (hat meie lepotition of coireot foims cause 
small gams on the lest It is possible that the small gams of 0 3 for 
one, thiee and ten lepetitiona of the correct forms could be explained 
as meie practice effect The original practice effect between the first 
and second trials on Test I was 1,14:^ and it is possible that there should 
be another small piactice effect gam between the second and thiid 
tiials At all events, when compared with the other pioceduves 
mere repetition of coirecfe foims is veiy inferior, 

2 If one recalls the gams found for molimiicn as desciibed in a 
previous exponment^ it will be seen that they sink into gicatei insig- 
nificance than appeared in the earlier article. Motivating devices 
apart from the learning exporiences offered are practically impotent 
3. It will be seen from Experimental Pioccdiiro IV that mere 
learning of definitions, rules and principles of giammai yielded an 
appieciable gam on the usage test This result was wholly unexpected 
and IS hard to explain. It was thought before beginning the expen^ 
ment that mere memorizalion of grammar rules had little or no influ- 
ence on usage The cxpciiment, however, indicates that somehow or 
other these Grade VI childicn extracted enough meaning from the 
formal and abstract definitions and rules with which they were prev- 
iously unacquainted to make more conect changes on the test than 
they did the fiist time. The positive correlations of gams with 
intelligence would indicate that this transfer was one that the 
brighter children profited by more than the duller children Within 
the limited use of language as found in this experiment it ls possible 
to say that meie learning giammar rules does impiove usage 

4 Tiaming in the analysis of grammatical constiuctions and 
practice in the choice of correct constiuctions each taken alone caused 
improvement in English usage Tho development of ability to analyze 

^Syiuonds, P M and Chase, Dons llai ter, Pi acEico vs Motivation Journal 
of ^duccLiional Psychology^ Vol, XX, 1029, pp 19-35. 
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sentences for gifimmatical consliuctions apparently had about the 
same influence on usage that memorization of the rules had. Practice 
in choice of cou'cet expressions had measurably greater influence than 
the learning of rules or analysis 

6 Merc repetition of the right and wiong forms m succession so 
that the distinction between the two is clearly brought out, and so 
that it is definitely slntod winch is the light foiin, had gi eater influence 
on usage than any of the work with grammar. 

6 The whole program including memorization of lulos, practice 
m analysis of grammatical constiuctions, choice of conect foims and 
mere repetition of couect and incorrect forms m succession yielded 
results in improved usage hotter than any one single method alone 
It is estimated that these Grade VI classes made a gam in conect usage 
which is orclinaiily to be expected in three yeais by working on this 
program fifteen minutes a day for three weeks. The experiment has 
not included subsequent testing to delcimino the permanence of these 
gains Presumably tlieic is the usual falling away and the re-adoption 
of habits picvalent in home and community 

Discussion 

One thing stands out clonily. It is the quality of dull oi practice 
that counts and not its amount. Merc mechanical lopetition appar- 
ently yields almost no learning. Instead of increasing the amount of 
drill in school subjects, more attention should be paid to the natme of 
the drill The best lesiilts come by making what is to be learned 
easily identifiable as Thorndike has emphasized in recent lectuies 

This study should not necessarily be interpreted as a justification 
of the teaching of Dnglish grammar Gi ammar does have an influence 
on usage, but at what cost? Without doubt for most children the 
difficulty and trouble of learning grammar as a means for improving 
usage IS so great that more diiect attacks on usage are certainly more 
profitable Our own ie.sults show that ineie repetition of correct 
forms, where it is clearly indicated what is coirect and what the critical 
point at issue is, has inoie influence on usage than any procedure with 
grammar. 

Foi gifted children the study of grammar may be piofitable 
In the fiist place, tho gifted child leains grammai lelatively more 
easily. In the second place, with general pnnciples to woik from, a 
knowledge of giarnmar will cover more cases Whoever really com- 
pichends a generalization litis command over a much wider range of 
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specific applications. But the average child finds it difiicult to learn 
the definitions, rules, and principles, and finds it difficult to apply them 
when learned. For most children learning correct usage is more 
profitably accomplished when the specific items aro learned directly 
The child who has learned by direct practice to distinguish right fiom 
wrong usage is probably hettei equipped to learn the giammar which 
gives a logical explanation of the habits of correct usage which he has 
formed. In this sense giammar is a summary or epitome of the usage 
which has already been learned directly, rather than a tool for guiding 
the learning of correct usage. In the writer’s opinion it is relatively 
unprofitable foi the aveiage child either to study grammar as a means 
for learning correct usage (because there are more ducot, simplei, and 
easier means for learning usage) or as a means of summarizing the cor- 
rect usage which one has learned (because there are other things more 
worthwhile m the curriculum). 

In all the expeiimental work it is tacitly understood that pupils 
are making some eifoit to do well m school, to do well on tests, to 
please the teacher, to do what other children aro doing, to learn new 
things, and the like Unless there was some driving force the pupils 
would never have taken the testa, or attended to or learned the exer- 
cises Oui previous experiment showed that additional stimuli to 
learning cannot be imposed from without. But there must be a 
mmimutn of driving force whieli can be depended upon to direct the 
children’s attention to what is to bo learned. The selection of mate- 
rial in harmony with pupil’s interests and pi^evious learnings is certain 
to produce better learning results than when interests and previous 
learnings are disregarded. 

It is always questionable as to how far the results of a single experi- 
ment can be extended to apply to dissimilar situations. The’ writer 
likes to believe that these expeiimental icaults apply to problems of 
conduct in. general This experiment demonstrates that mere learning 
rules or codes has a direct influence on conduct, more for the brighter 
children than foi the duller children. A.pparently these children 
extract enough from the formal rules to apply to their own behavioi 
The practical pioblom, however, is not Can rules function m conduct? 
but What is the most economical method of guiding or controlling 
conduct? This depends partly on the person's ability to compiehend 
generalizations and apply them to specific situations. Piobably for 
the majority of people the simple direct method of telling them what 
is the "right” or best thing to do will produce the best results. And 
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if it is not known or not certain that one thing rather than another is 
right or best, or if it depends on the circumstances, then it is preferable 
cither in the first instance to teach nothing, or in the second instance 
to give considerable help in solving the problem which will fit the 
lesponse to the circumstances. 

Tinally, a word as to the cxpeiimental attack on piobloms of this 
type as compared with correlation methods Correlation analysis 
13 essentially static. It merely reports the results of whatever methods 
or combination of methods have produced the present situation. 
Correlation analysis does not begin to exhaust the possibilities m 
method— it does not even experiment with method. Correlation 
analysis is extremely limited insofar as its guidance for education is 
concerned The point has been reached where the correlation method 
has about exhausted its possibilities. The time has come for a more 
earnest use of the experimental approach to problems of learning and 
education. 

However, if the experimental method is to be used it must give 
heed to the law of the single vaiiable Every true experiment m 
education presents an artificial educational situation. Time and 
again duung the course of the work reported in this article, principals 
and teacheis would complain that the methods which were being 
used were too foimal and diy to be practically used. To this I would 
agree To most persons an educational experiment must make use of 
the best conceived organization of methods and materials possible. 
Not so. The actual educational situation is too complex to be used 
in experiment. When one has compared one actual classroom method 
with another, one does not know to what specific factor to attribute 
the lesults In true experimental woik a single factor must be pulled 
out of its setting and alone be allowed to vary Only in this way is 
it possible to build up educative procedures that are based on correct 
principles 
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Univoisity of Cliitngo 

The Problem 

Tho purpose of this article is to describe the construction of a 
scale for the measurement of rQilitaiism-paci&sm The teim "mili- 
tarism-paoifisin” is used hero to specify a particular attitude. In a 
very broad sense it denotes a predisposition to act with reference to 
the issue of war »s. peace. 

To measure militarism-pacifism directly is impossible One cannot 
enter into an immediate contact with the predispositions of other 
persona. As an indirect measure of attitude the verbal expression 
of a person, in the form of statements, was chosen The statements 
cover the following topics in this field; Cauaca of war, purposes of wai, 
results of war and peace, what is to bo done at present about war and 
peace, what is to be done in case of war, and general judgments about 
peace and war. 

We can assume that theie is some relation between action and 
verbal expression. That is, n peison who endorsed militaristic state- 
ments would probably tend to act like a militarist, and a person who 
endorsed pacifistic statements would be likely to net like a paci- 
fist. However, no assumption is made as to tho extent of relation 
between the verbal expression and action. If at is discovered that 
a person has endorsed statements indicating a pacifistic attitude, 
one cannot be smo that he will also act exactly in aocoi dance with 
his endorsements 

In the piesent study verbal expressions or opinions will be used to 
designate the successive steps on the mihtarism-paoifism scale In 
constructing the scale it will be desirable to find some way of detei- 
raimng the distances between the successive steps on the scale. It 
will be desuable, fuithermovc, that the distances between the steps 
he approximately equal. How to equalize these distances constitutes 
the chief problem 

To summaiizo, the mam problem of this experiment is to construct 
a scale of militarism-pacifism with approximately equal steps on the 


’ Tho scale, in a modified form, together with instructions for its use, wns 
published by the University of Chicago Piess. 
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scale — the steps to be represented by statements of opinion concerning 
wai and peace. 


The Method 

A set of two hundred Ihirfcy-sevon statements expressing vanous 
degrees of militarism-pacifism was collected from several sources. 
These sources may bo divided into three mam divisions. The Iiteratnio 
on war and peace, statements about the issue of war as peace written 
by one hundred undergraduates and twenty graduates, and a number 
of statements devised and modified by the wiiter Out of the two 
hundred thirty-seven statements sixty-seven longest, least clear, 
and lea^t relevant statements were discarded Three professors 
and the writer then went over the lenminmg statements, and as a result 
forty more statements weie eliminated, leaving one hundred thirty 
statements for use in the experiment. 

Three bundled students attending the University of Chicago 
were used as subjects. Among them weie eleven unclassified, eleven 
fieshmen, ninety sophomores, fifty-seven juniors, thirty-mne seniors, 
forty-two year graduate students, thirty second year graduates, 
seventeen third year graduates, and thiee Ph.D 's. Moat of the 
subjects were students taking elementaiy psychology Other depart- 
ments which also assisted weie sociology, political science, divinity 
school, and education Only voluntary service was asked for except in 
a few cases when the instructor made the experiment a substitute for 
some class exercise. 

The presentation of the material was made in some cases by 
the experimenter, m others by an instructor. Generally the envelopes 
containing the mateiial were distributed first during the class hour 
The experimenter then read the instructions while the subjects followed 
liim in reading then own sheets. Any questions asked by the students 
at this time were answered. The subjects weie then asked to do the 
task at home and to return the envelopes with the material complete 
in a few days 

When the student opened the envelope he found in it the following 
material: A sheet of msti actions, one hundred thiity statements 
each on a separate slip inches by 4 ).^ inches, eleven index slips 
of the same auie, each labeled with a Roman number I-Xl, and a slip of 
similar size foi obtaining the necessary infoimation about the subjects. 
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The subject was instiuctcd to lay out l)cfoic liiin the eleven slips. 
He then was asked to put on slip I tlio.se statements which he believed 
express the most cxtiemcly militaristic opinions On slip XI he was 
requested to put those statements which he believed express the most 
extremely pacifistic opinions, and on slip VI to put Lhfi.so which he 
thought express neutral opinions On the icst of tho .slips ho was 
inatiucted to arrange the statements in accordance with the, degree 
of militaiism and pacifism expressed in them. 

Only about sevenly-fivo per cent of the envelopes were returned 
This automatically eliminated some of the most ciiieless indivKlimls 
A few envelopes were ictuincd unused which iviis piefeiable to a 
thoughtless and hurried performance. The index slips and tho insti ac- 
tion sheets were returned in most cases and weio used oven- again with 
the newly prepared sets of statements. 

The frequencies of judgments obtained from (he three liundiod 
students for each statement wore tabulated, Talilo I shows (lie fre- 
quencies of judgment only for stalcmciUs chosen to constitute the 
final scale. These fiequencics wcie then cumulatively added and 
the percentages of the total three hundred judgments detminineil 
for each of the lesulting sums Three 8amplo.s me nhown in Table II 
It 18 evident from the second column that statcnu'nt nunibei 9 avus 
put in group I (first column) by two hundicd fifly-foiir subjects. 
Two hundred fifty-four is 84.6 per cent of tho llirce lumdusd sulijects. 
Twenty-eight people put the statement in group H Adding twenty- 
eight to two bundled fifty-four, we got tAvo hundred cighty-lAvo Avlucli 
is ninety-foui per cent of ihiec hundred. Seven people put llio 
statement in group III. Seven and tAvo hundred eighty-two i.s 
two hundred eighty-nine; that is, 96.3 per cent of the total nmnbei of 
subjects or judgments. Percentages thus obtained Aveie called cumu- 
lative proportions 

The same method of calculation was used for all the one hiindreil 
thirty statements In order to show how this method applies to all 
kinds of distributions the three statements, 9, 10, and 8, wcic puv poscly 
selected to represent thiec completely different distributions. Stak'- 
ment 9 was put by most people to the extrcnio left, statement 10 m 
the middle groups, and statement 8 in groups lying to the extreme nglit 
(acfc Table II) 

From data such as found in Table II tho cunnilativo proiiortioii'. 
Were plotted against the eleven group,s or degrees of nulilarism-iiuci- 
fism, Sample curves are shoAvn in Fig. 1 Mililansm-pacifiHin 
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Table II.— Calculation op Gomulatiic PHoi'OiiTioNh 
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•'t Sr*ilr f$f 

wns rcprc'-fiiU'd nn flic It.-i-c Init* h.v HutIovcii groups luiining from 
cxtrcmrly iiiilil!»rif'(>r kio>i))s It) oxlrfiiioly paclfistic onea The 
cumuldtivc proportions wort- hicdlcti ou Iho y-uxw running from aero 
to one luiiHii'cd. 

Sample oiirvi's nrcsliown m log 1 Milifariam-pmnfiamwaa repre- 
sented 0(1 the lm-(- line l»y the ele\en groups running from extremely 
militaristic grtnips to extieinely pneitistie ones The cuinulalivo 
proportions were loealett on i|h‘ y-iuis running fiom zero to one 
hundred 



From the enries lliu*' olilmiietl two \alues were floloi mined t 
The Hoale \nliu* nod the ipiarlile devniliori. The scido value of a 
Btatomenl wns found n*’ follows Siuocwhere on (he chaifc tho curve 
intCTSCCtH the liftv pm' eml lion/onlil linCj llint is n hno running 
horizontally nt (lie h vet of liflv pi‘) eeiit and at light angles to tlie 
y-axia. Fioin the ]itiint of iiili r-eeiioii a line nan dropped at right 
angles to llie x-oms 'I’lie pnmi wlawe (Ins line mter-ects the base line 
(Icloimincd the H-ide \ due nt ilie ‘.talement The hcale value of 
Btutement U)(M'e Fig. U w eifiiuiwl loliefitlaudteeordedonthcnglifc- 
hanrl side of I to* (igiiie A Himibir pioeediire was followed in finding 
the seale value of )”itli of ilie otu' hiiruiieil thirty staleiiieiits 

With Koine of i|ic eMieine i.tali no nl>(, liowevei, the curve did not 
reach the liflv pm leiit line KMunples of this may he found in 
Fig, I and Fig H. In t*ueli vi'-es lUu curve was jiioiected at sight down 
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or up iis fur us Ihc fifty per cont line. Naturally, buch proccdin c is not 
qinlo ub ucciiiiik' ns when Uic cuivc reaches the fifty per cent lino, but 
it 18 the be.st ineihod ivviulablo for the extreme curves, 

Vaiiuliility of a slatmnoiit was inciisurncl by tlie sonn-inloiqnartilo 
riuiRe or quaililc doviution, designated by Q The gicator the value 
of Q, till' moie variable I, ho stateinent, because people disagree more as 
to wliere llie stateinent belongs. Q value was obtained by simply 
reading off the, range on the base line concaponihng to the distance 
between the two iiombs whole the curve intersected the twcnly-livo 
per cent and the seven ty«llvc per cent horizontal lines, and dividing 
this distance by two, The vaiialnlity of statement 9 was found to be 
0 2, the variability of slatcmonl 10 was 0.8, and that of statement 8 
was 0,‘l (see Fig. 1). 


Tiiii ScAnis 


1. Conslrudum — The next task was the selection of statements to 
coiibliUile tlie final scale. Two major cntcria used for this purpose 
were (a) the Hcale vitlucs and (b) the Q values All of the one hundred 
tliiity staleineiilH weie aiiaiiged first on the basis of the scale values 
in ahcoiiding ordoi, ranging be-tween 0 5 and 10.7 Ncaily cvciy stop 
111 tliis range was lepresented by several statements of practically 
identical scale vulueH. All statements of identical scale values wcie 
arrangiid according to their Q values 

It was d(>ci(U’d that there would be twenty-one step-s in the entire 
scale, encli slt'p to be leprcsented by one statement An additional 
statement was to iepre.s(*nt the origin. Approximately two statements 
were picked from each of the eleven gioups. But in so doing the 
expcrlmcnler wa.s guided by the scale values of each slatemont rather 
than by the, groups. 

In case of idenlicnl scale values the least variable statements 
woie picked as measured by the Q value In a few instances both the 
scale values and the Q’a weic identical Two minor criteria were used 
m cases of this type . The, brevity of a statement and the shape of the 
curve of its (hstiibution. A regular cuive was prefened to a less 
regular one and a short Blatement to a longer one. 

As a icsult, H 81 ‘iies of twenty-two 8lalcinciit.s weio obtained that 
weio about equnlly spaced along the scale. The distance between 
two adjacent slatcmcnls hcoined to the three huiidied judges, on the 
whole, as large as the distance between any other two adjoining state- 
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menls. In terras of scale values none of those dislunces was larger 
than .6, and none smaller than .4 with the exception of tho clifitance 
between the last two statements, which was .3. A socoiul form of the 
scale was selected by examining tho scale voluos and the Q’s agam and 
picking equally spaced and least variable ataloinonlH, Twenty-two 
statements were selected to match the first form ns nonily us iKissible. 

The scale was readjusted on the basis of the frcqiiencieK of ('iidorsc- 
ment obtained from, four hiuuhcd students. The ficiiiicucies of 
endoisement wero cumulatively added, and cncli sum in one of the 
forms was compared with tl»e corresponding sum in the other form. 
If one of the sums was larger, the statemonla were exehaiigofl so as to 
balance the frequencies in one form with the frequencies m the olhev 

After the two forms were thus equalized the scores weio culculalod 
for each and all of the four hundred subjects The distnhlUions of 
the frequencies of scores obtained fiom the two forms are shoivn in 

Pig 2 

2. Descnpfjon.— Forty-four selected statements constituted tho 
main body of the scale in two foims. Thus each of twenty-ono stops 
on the scale was represented by a pair of statements One pair, the 
most extremely militanatic statements, represented the oiigin and were 
designated by 0, Tho two most extremely pacifislic statements wen* 
designated by number twenty-one. In order to assuio greater atten- 
tion and careful reading on tho part of the subjects, the slatcmcnla wori^ 
arranged in random order. Written mstiucUons wore found ivt the 
beginning of the scale. Attached to the scale was tho iiiforniatlon 
sought about those to whom the scale was given 

The instructions, the scale statements, and tho infoi ination boction 
are repioduoed below. In front of each statement code numbers aie 
found, After each statement in tho parenthesis tlirco iminbciH aie 
given: The scale value, the quartilo deviation, and the equivalent 
number (about double tho scale value) of that statement. The latter 
number was used in scoring. In giving the scale these three numbois 
are, of course, omitted. 


A Some ot Militaiiwm-Paoifism 
Insliuclioiia 

Tho purpose of this oxporimont is to inonsmc diffcrciicps in opinions K'lnlinn 
to peace ond war Below you will find n number of Btatcmcnta cxiiioHSing vni ions 
degrees of opinion about milUaTism-paciflsm, 
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A Scalf of Mtljim mn-pact/mi 

If, on llio lioli'p ^ou fip;n»o w lOi tlu* «oiilimont of a fltalcmonl, mark it with a 
plus sign in 

If, on Iht' with Ht'ntnnml of a Btatoinonb, mark it witli 

a imnuH m iUv 

PIousp voU^ fur oarli Htalrnipnl ovoii if it BPonia anihiguous and you havo to 
make Honip h<hI of gni‘i*'< 

Only nia^'« n suits \\ill lip pHliliMlinl wliioh will not distinguieh individual 
0|jinioTi. 


Stalmnpnta 

( ) h MullUndrfi im' hrnc*filiMl by loarmng Iho lesson of war-timo cIiscipUiio. 
(:i0, 0 0, 5^ 

( ) 2. War in llio luoflorn ^^orld is aa nrcdlesa aa it is suicidnl (9.5, 0 9, 18) 

( ) 3. 'I’JiOHP iinhlnry nmta Hhould lie rotamed which aflord training to the 
bttdy nud uund. <4 8, 0.0, 8y 

( ) 4 Athiv diwcijihno injures w'lf-rcspccfc and ludividunlity, (8.0, 0 9, 16) 

( ) 5 TJie Ioksph hi bnnian life and property, groat as tli 03 ’^arc, are amnll evils 
eoinpared to llin umlennining of luorala aad the lowering of etandaids of 
euUure ami eiviliralion caused bj' war (0 0, 0,9, 17) 

( ) 0. Warn are justdmblr only nWioii Viflgcd m defenso of wcakci jmlions 

012, 1 1,1)) 

( ) 7 War m ennobhim and Mliiniilativo of the highest and best qualities of 
huiimnknul (1 0, 0 K, 1) 

( ) 8. It Iht'* moral d\ilv of Iho unh\ idunl to lefuBc to participate in any -way 
in au\ war, no iiiiUler what (ho rnuso. (10.7, 0 4, 21) 

( ) 9, Might \H (0 r», 0 2, 0) 

( ) 10. 'J'he iiiOHl that sve can hope to fiecoiniihsli la the pailial elimination of 
war, (r,0. (18, 10) 

( ) 11 The evils of win arc alighlly grcaloi llinn its benefits. (0.5, 0.5, 12) 

( ) 12. Until an f‘<piivjdoiit diMipline h organised wm niiiBt Imvo its own way. 
(8 0, 1 0, 0) 

( ) 13 HceaiiHo right inav lif‘ mon» iiiifiorlniit than peace, war may bo tlio lesser 
of iNVo cviin (4 2, i) 0, 7) 

( ) M Along with pntnniHiJi woild-eiti/ensliipehould be taught in all socondaiy 
Hclionls. (0 Oj I 0, II) 

( ) 15. Persons fihoiild pledge tlieinsclvea never to nid any futiue war (10.4, 
0 5, 20j 

( ) 10 U H alinosL uupo^'Mble to lime a iaigo inilitaiy foice without being 
tempted to in-e it (7.0, L 0, 13) 

( ) 17. Win IH !he tonic of (1 0, 1 1, 2) 

( ) 18 M9ieii the ii(‘\t in lucnkK out we should tell tho diplomats who lead ua 

In it liiut we will not follow them (10 0, 1 U 19) 

( ) iO. MililuiiHiii m necc'^'Muv foi tho piOjU'r defense and jnotcchon of tlio iiuli- 

N’ldunls of II coiiiitrv (2 0, 1 t), 3) 

( ) 20. 8{) long im imv people, while, black, hiown oi yellow, hold weapons m 
Ihcir Inuiih, we nuHt not eomnut tho folly of dmiiiiing. (2 6, 1.0, 4) 

< ) 21. (Jjidi'i iliehCoingeofwaraimtioiihnsnooppoitunifcyforciiltuialdAvoIop- 

riKMit (8 4, 0 9, 10) 
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( ) 22 Tlio soldiisr suffeia trcmendoii«ly and ruiiih very hllV' (V ()> \ 0, 14) 

( ) 23 The evils that ivar bring*) iii iti Irniii fur oiilwcigli nnv pos'iililo lioiipfila 
(8.0, 0 9, 17) 

( ) 24 Wo should have a modornlc amount o( inilUai> ItiuniHg in our hi'hools, 
{4 4,0,6, 8) 

( ) 26. No seliomo of nggiessioii or cotuiucat tnii bo pnrHUpd for any ooiiHiilciobli* 
IcngtH of timo without entoobling victor tis well ns vniiriiiiHliod. (7 4, I 1, 
13) 

( ) 26 When ivar threntens wo Bhoiild rofiiso the cull to sen icc nuil iiiorciiso our 
anti-war activity (10 8, 0.7, 20) 

( ) 27. It IS foolish to talk of tho nholition of war, sitice jnigiiariiv is nn incruiiicii'. 

bio human instinct (2 8, 1.0, 4) 

( ) 28 There is no piogrcss without war (0 0, 0.7, 0) 

( ) 29. Militaiism should bo abohshod from llio ciirririihiin of Hip slnlp schools 
(8.4, 1 1, 16) 

( ) 30 It isnotin war but 111 ponce and prospciiti Hml our worst vups dovclop 
anil glow rank (2 1, 1 1, 3) 

( ) 31. IVo cannot hope to do awav Willi win, hoenusp it is pnrl of llip niipncling 
stiugglo fot suiyivnl in a ciowdcd woild (2,9, ( 1, I) 

( ) 32 If aimed conflict between imlivulualH iiikI iifics can he (uillftwcd, it is 
possible to outlaw armed conflict bolwccii nations (7 .S, 1 0, 14) 

( ) 38 Every war shows cownulicc, imiidoi, nihim, giafl, and !(‘aM‘s n frail of 
pci&onal and national domoialiration. (9 8, I (I, 18) 

( ) 34 The most frequent cause of wiir w the nvali > of imlioiis foi posiCHSioii of 
tcriitoiy, markets, eoiiccesions, and npheres of inlliicncc (.'» 0, ll 1), JO; 

( ) 36 Tlioro m no conceivable jiislificntioii for wai (1(1 7, 0 7, 21) 

( ) 30 MiUtniy training is iinpeiativc, lint it Bliould lie voluiUarv. (4 1 , (1 8i 7) 
( ) 37 Nations should agioc not to mlprvpiic witli militaiy foicc in purely coni' 
inoicial or financial disputes (0 3, 0 0, 11) 

( ) 38 CovvccnungwarWcnwistboabiiUlionists. (10 9,1.1,19) 

( ) 39. Tho abolition of war would mean efloiiijimcy, wiftness, debilitation, and 
degenoiacy (1,0, 1 0, 2) 

( ) 40. A host of young men ontcicd the wai in a stniit of idpiilisni and uusellisli 
devotion to a groat cause, only to leturn diHilliibioiied and i-ymcal as to 
tho value of ideals (8,1, 1.0, 15) 

( ) 41. For the liberty of oppiobacd nations wais slumlil be /ought (3 4, I 0, 0) 
( ) 42. Compulsoiy military tiatmng should bo ostnlilishcd ni nil coiniliies 
(1 0, 0.0, 1) 

( ) 48 Pugnacity, uvalry and self-intoicst aic naluml, but need not lesidt in 
wai any moie than human dcsiro toi donnnanre need result in shiveij 
(0 8, 1 1, 12) 

( ) 44 Peace and war me both essential to progiess (5 4, f) (i, 9) 
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,l iSV«/<’ nj Mjhlnrwii-paciJiitni 
liiforiiititioit 


Nan IP 

ClaKfifiralicn (iiiHl'tliiiP oupi 

lii>liiii;ui , Inn KM (Iniiliintp 

St{i)iiiiiMirp S‘i nnir 

Sex (iiii<|pr)iiip "n'''- I i ni'tti' 

Agp 


a. Scoring Kor M‘i»ring cillicr Ilio oiiginal acalc values or the 
cquiviileiil, imiiiliiTs nnplit he In iIhh oxporiincab for the pur- 

pose of hiinplilK’nlii'ti mill hl•(•uuM• (lie (menial hculo values wercfaiily 
cvcjily ilit^liilmlinl, niui\i‘li-ii( imnilirrs were used as abasisforscoiing 
The scorn was llu* tivniiign uf (lii> «>(]Uivatnn( numhnrH of the statements 
niarkcd plus 

‘1. Hdinlnhlif, Fur nalrul ilioii of the lelmhility of the sealo 
the mnlliod of form coiniimi'-oii \vii« rhosnu. For thm purpose the data 
obtained fioiii four liuiidii'd Mudents (sne upphcnliou of ecalc) wore 
U8C<1. To noiri'lntn lhi« (wo foims (lie product moment cocflicicnt of 
coni'lulion was uw'd. T’lu> roni'liiluui was found to be +.83. The 
Speanuaii-llrowM fonuula when npplind (o this ruvo a value of +.90, 
which i» llK‘«'\ptT(i'd rorn+dinii of tin* Iwo foniisif coricliilGd with two 
otlinr foruvK. TUo ludnr mirH-liUiou is Ui lie icgurdeil us the reliability 
of the lolal hcalc nw ii'-ni in Kh application. 

Ari’i.if.M ION oi THi- ScAi.i: 

The <>oiis(rurli‘d Hcab' was gunii to four Inindrcd students attending 
the Ihnvor.-'ily of < ’Innigo Thr four humlnsl sludonts mcluded eight 
frcshinnn, one Inindred lliir(,i-''i\ soplioinoir.s, nincly-six juniois, 
8ixty-Hi\ (-triiors, eiglUy-iliree giadualn.s, and eleven unclassified 
students The ages of llie^e subjects ranged between seventeen 
and forty-four, (he hm rage bung -18 Scores on the sealo were 
studied III rel'Uion (o foin faelum' ImIuciUioii of Hludents, scholaisliip, 
sex, and I'luiieh allilmlion 

1. KduuiUm of StinUnh '1 he four hundred lenoids woic aiiangccl 
on the bieiirt of (In* i diienlional HtatiiH of oaeh stiidi'iil llccords of 
fiCKluiieu \veii‘ }iii( in one gmup, leeoidH of wiplionioi'ea iii niioLlicr, 
luul HO nil. .\ll III all, live gioujis were ohliiined The types of groups 
and the luiinber of al iideiils in eai'h me .sliown in Table III. For each 
of the groups mi aveinge of the ecoies was then calculalecl, also the 
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standard error of the average, and tlic standard deviation of llie dis- 
tribution of the scores. 

A tendency may be observed \u the bucccbsivc di(Tor<‘nccs between 
the averages of the five groups. If taken separately they are hardly 
of any significance, but when compared one can olrscrve a cerliiin 


TaciiH hi 



Clnsa 

AT 

Mrnn 



No 

Kcoie 

tTm 

___ 

(T 

1 

FresUmou 

8 

11 23 

71 

•2 02 

II 

SophomorcB 

130 

11 32 

2(1 ! 

2 3r, 

III 

Juniors 

00 

11 .lO 


2 Oo 

IV 1 

Seniors 

00 

11 03 

:is 1 

2 30 

V 1 

Graduatca 

83 

12 82 

n 1 

2 IG 


definite continuity from one group to another. These diiTercnccs all 
run m the same direction, which indicates a tendency toward greater 
pacifism ns education increases. This increase i.s graphically repre- 
sented in Fig. 3. 

The second feature of the diffcronccs is thdr gradual Lnoroase. 
This function, somewhat magnified, may also bo seen in I'ig. 3. A 
curve drawn through the averages appeals to bo iiostively accclcralcd, 
the scores ranging from the mean score of the freshmen class to the 
mean score of the graduates. 

These results tend to indicate that education has Bomothing to do 
with the formation and modification of altitudes towaid war and peace. 
With educational advancement students tend to become moic favor- 
able to a peaceful way of solving international differences. Tins 
general trend is seen m Table III and Fig 3, according to which there 
IS a continuous change in attitude toward pacifism as the studonls 
advance in the college to the graduate school. 

2 ^'c/tolars/wp.— Scholarship standings were obtained from the 
Bureau of Recoids for two hundred twenty-seven sludcnls. The 
undergraduate grades were expressed by the number of points. But 
the graduate grades had to be converted into numerical values by tlic 
experimenter This was done as follows: II = 0, P - 4, U = 1, 
/no = 0. An average score was then calculated for each individual. 
A range of .60 to 6,50 in scholarship values wa.s obtained. The 
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A Scale of Mthlarism-'pacifism 

Pearaon cocflicLcnt. of oorielaiion between the scholarship values and 
militau8in-i)acifisin was found to bo +.15. 

This low correlation aeems to indicate that there is little or no 
relation between scbolaTslnp and militai'ism-pacifism If there is 
any, then tliero is a slight tendency for pacifism to eoiielate positively 
with scholarship. Students of higher standing m scholarship tend to 
1)0 pnciiisls. 

3. Sei - -Among the students tested two hundred twenty-five were 
men and one huudicd seventy-five women. The average score for 
men was found to be 11 5'1, and for women 12.30, the dillerenco between 
Llio two being .70 The standard error of the difference waa 20, 
which is less than a thiid of the difference. This indicates that women, 
on the whole, arc more paciflstic than the men. The extent to which 
the two groups overlap may be seen by comparing the two distribu- 
tions in Vig 4. 



II is also evident from the figure that the disfciibution of the scores 
of men is wider than that of women In terms of the standard devia- 
tions the vai lability \vaa found to be 2.30 for men and 1 98 for women 
Women appear to be in bcttei agi cement regarding the issue than men, 
and tlicie appear to be many more militarists among men than among 
women 

4. Church Affiliahon,~l)sila on churcli affiliation were obtained 
from tlie university files. Ten denominations having the largest 
ic))rcflontalion weic selected for study ns shown m Table IV For each 
an average score was calculated, end the denominations were then 
arranged in descending ordei 
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Tmhx IV 


Denomination 

CllH{‘S 

Moan si'o) i* 

Discjplca of Clirint 

0 

13 0,1 

Baptist*? 

il 

12 fi? 

Jc’WS 

33 

12 H 

Piesbylenanw 

2t 

u % 

ConKrogatioiiiiliHls 

11 

11 n*j 

Methodists 

21 

ii 10 

Christian Snon lists 

8 

U 42 

Catholics 

14 

U OS 

Lufchomna 

7 

10 ori 

Episcopal mns 

14 

10 00 


The numbei of cases in each (Icnoiniiiationnl group is not large 
enough to warrant any definite conclusions, but the i osuUs are intoiost- 
ing and suggestive. The most piicifiatio churches tntiy be found at 
the top of the list and the least pacifislic at the IkiIUuu. 'I'lie lliico 
churches most similar in form, the Calholio, Liithoriui, and liio lOpisco- 
palian, seem to be similar m attitude and occupy the lowest three 
positions That is to say, they tend to bo tho most riiilitarisi.io 
denominations of all the ten. Disciples of Christ, Bnpti.sts, and Jews 
stand at the top of tho rank order; Prosbyloiians, CoiigiogationalisU, 
Methodists, and Cliiistian Scientists arc in the inidillc 

CoNcnusiONH 

The following brief conclusions may be drawn from the exporiincnt 
described in this article: 

1 By the use of the method of equal appealing inlorvahs it wns 
possible to construct an evenly graduated scale of inilitausin-imcifiRin 
The unit of measurement was one-olevciith of tho nuigo of attitude 
between the most exticmc degice of mililatiam and tho mobt oxtiomc 
degree of pacifism represented in our list of statements. 

2 The reliability of the scale was found to be -b.Dl) 

3. Education appears to develop pacifism us nicasuied by the hciiIo. 
A consistent change toward pacifism was loiiiul for Die hucci'hsivc 
undergraduate classes and tho graduate clauses. 

4. A coefficient of coiTclatioii of + 15 was found botwi'cri null- 
tarism-paeiflam and scholarship. 
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A tScale of Mtliiausm-paafisvi 

5 Woinoii appear to be more paciBafcic, on the average, than men 
Men vniy more tlian women 

6. The Catholic, Lulliciaii, and Episcopalian seem to be, on the 
average, the least paciaslic churches of the ten compared. Disciples of 
Clii'isl, Eaptisls, and Jews appear to be most favorable to the peaceful 
method of solving inlornalional problems. 



miLT THE THEORY 01'' FAO'J'ORS 18 i\'()T 

C SPEAUMAN 
Xlmvcchity ot Ixindon 

Not long ago there was held a very novel an<I wiccc'-sful pluilo- 
graphio exhibition The pictuica acnl in woic not as UHiinl llio Ijcsl, 
but the most instructive. Among them weio those got fioni iindor- 
expoauves and fiom ovei-exposuics; those whoie llie nninciHion in tlio 
developer had been too long, and where it luul boon too shoit; whorn 
the focussing lind been faulty, and where llie camel a liad been Hhnkcii, 
wheie the lens liad caused flaic, oi the belloivs had not been light- 
proof; wheie the printing paper had been stale, or not of a suitable 
kind, In a word, the pioturca suRcred from the tliouannd and one 
ills to which the photographic art la heir The gieat idea of the 
exhibitors was, of course, that their own unfortunate oxpciicnoes 
should serve to warn others, 

Now, if not too presumptuous, I would lilco to suggest that a some- 
what similar general service might be afTordod by a book which hiia 
lecently come fiom the asaomblcd strength of the psychologioal depart- 
ment of the University of Minnesota, ns lepicscnted by ProfessorH 
Paterson, Elliot, Anderson, Toops, and lleidbiedei; a volume, more- 
over, fortified by the unstinted financial support of the National 
Research Council i 

Taking first the historical aspect of this woik, we uie told in il 
that the theory of two factors was not ‘'defimloly advanced" till 
1914, having previously been only "implied,” Now, if such an 
unhappy account can befall the diatmguiahed Mimieiiotii hyiulicale, 
surely there must be many others who arc not ciuile clear on Die ma( ler 
and would gladly be informed. In truth, the very first publication 
about such factors (this wag ten years carliei than the date mentioned 
above) supplied perfectly definite obscrvalione and at (he hiuno time 
a mathematical entenon so exact as to be Hub,s(antialiy lliat used 
at present. The chief final conclusion of the ivliole work lan (in 
italics) as follows: 

All branolios of intellectual activity Imvo in common niio ruiulumoiilnl fiiiiiil ion 
(or group of functions), whorcas the icinaining ov himmsiIic I'U'uuMits of llie ivcUvity 
seem in every ease to bo wholly dilTorent from Hint m nil iho otlici oiihOM a 

Aiiytliing more piecise I, for my part, ooiiUl hardly foimiilate 
to this day. Further, not only wcic these two faclom, ii and S', 
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explicitly piochuinoil, even tlieir vciy influcticcs wove actually dis- 
covoicd tuul inoamncd Wlial is still moie, lliis oiiginal publication 
already drew tho pructicul corollary (wlucli was so biillinntly exploited 
the followuiK yeai by llioefc and Simon) that the g can actually be 
incnsui'C'd, tliiH is done by tluowing tORCtlicr any hotchpot of tests so 
mimci’ouN mid holeioKoncoiis tliat, on the whole, the influences of 
the a’s nime ov less jwvfccHy neutralize' each other This, vital 
coiolluiy was iiulicalod by the vciy title of the article, ‘"General 
Inlelligenoo' Objeotivoly Dolcunmcd and Mcasiued." 

Incomparably more linporUint, howevci, than any such mere 
histoiy of the doctrine of two factors is the exposition of ita essential 
nature According to the authors at Minnesota, tho basis of the 
doctrine is "simple enough”, Ihcir chaiactcnzation runs as follows. 

It IS ryiinnonly obsiiinod tlmt a perfect hioiaicliy creates sfciong picsiiinption 
tlint n gpiioriil fiiclor m at woik 

For ventilating this view wo must be more grateful to them than 
ovoi , since it not only departs from tho actual slate of affairs, but 
turns it upside down and inside out. In truth, no "assumption” 
01 “picsuuiption” has over been made at all about the occunence, 
01 even incaHii lability, of tho g and s Instead, iigoioiis proof is 
given that in the said case of hierarchy (more strictly speaking, 
"cqui-proporlionnhty”)| and solely in this case, the scores in tho tests 
or other vmmbles can always be divided into tho.se two factors.* 

AVhat IS tho good of this, it may be asked? For can not the tests 
equally well bo tUvidod after any other fnshioti? The answer is to 
conct'fle that, so far ns the matlicinatical theorem goes, othei modes of 
division — perhaps an infinite number of them — certainly are possible 
But ycl otlipvs, and oxtrcnioly impoitant ones, are nof possible. Thus 
the Lcsls cannot possibly (wheio tlio critciion is satisfied) bo so divided 
ns to admit of any gioiip factois (of appreciable size). Again, the 
tests can not possibly be so divided ns to have any general factor 
othei Ihiiii our q Here wc notice that, although the theorem does 
not in itself sujiply any evidence that the g deserves the title ot “intelli- 
gonce,” still it does dispiove the existence of any oihci' and different 
gonci'iil intelligence Of course, there may be other mental operations 
that anyone may liko to call "intellectual.” But then these can, at 
ino.st, only constitute clussos. Tlicy can not possibly be geneial 
in the sense of having functional unity 

The furtlioi question still remains open, however, as to why we 
should give picfcrcncc to the division into g and s ovoi any othei of 
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the modes of division that the said innlhcwiatinal llicoioin really Idocs 
leave open A facile reply (but quite coi'i’cct, so fur iis it goe!^) is 
that this mode of division is the simplest. Ihit peiiclmtiiig nloic 
deeply into the essential chaiactcr of cmpiiicul Hciencc, we may uiiHwer 
with greater bieadth that thc-se two fnetor.s lifivo liilhorlo shown Ihmii- 
selves to be those divisions about which the inoHt iitipoi (iiiit sUiUnniMils 
and diacoveiica can be made. To incnlion only a few wo shall see 
many more later on— it was in g that Ihc iiispiialion loiilly niose fm 
all the ourient tests of "general ability/’ or even of "iiioiilal age", 
only in g do all these tests to tins hour find any stable uuclinragc amid 
the shifting sands of tho nibitary nn<l gieen-tablo conc-iqilions of 
"mtelligonce”, and with icspect to our factors alone can bo nn'iiauied 
the scientifically indispensable '‘probable cirois ’’ 

Another object lesson is nffoidcd by those authors at Miimosola 
when they embark on the tioublccl seas of coiitiovcifcy. But heie, to 
speak with frankness, they give some occasion for suipiiso. They 
bring against the theory of two fnctois the following pair of objections, 
The one is that the inter-correlations between their tcsls have tinned 
out to be low Suroly wo might have expected much leas oininent and 
careful authoiities than these to know at least Dial the tlieory is m no 
way based on the absolute magnitudes of tho coi lelulioiia, lie Ihe.so higli 
or low, but solely on thoir latios to each olhoi . The secoiul objection 
laised 18 that in their results the ciitciion of "nitorflolumiiar coirela- 
tions ’’ did not average +1.00 But here thoir luck wna out altogotlior 
A look at the woik which introduced and deiuoiisi rated this enleikm 
will at once show that they have used an oiiliiely wiong fmniula,' 
that, moreover, they have applied tliis uiulei coiidi lions that would 
rendei even tho right formula quite inapplicable,'’ and yet further 
that the whole ciiteiion was from the very lieginning declaied to lie 
only provisional and has now become quite obsolete o 

To crown all, even if they had applied the puipei ciilcuon and had 
obtained similar icsults from this also (as they would actually have 
done, for in this case the many wiongs end by making a right) even 
then these lesults would have been no contiadiction lo oui work 
For in this particular case of theirs, oui woik shows that the enli'iion 
ought not to bo satisfied. 

This brings us from tho pieccdmg negations of the Minnesota 
investigators to their positive contributions. IIoio the lesson at issue 
is the delicate one of distinguishing between mciim and Imim. In 
the first place they lay claim to have advanced the general liypollie.si-^ 
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of objectively doteiimuod “unique titiiis”; whereas it is hard to see 
that those ave anything more than the old factors camouflaged iindei 
a new nanio* And in the flecond place (and it is the theme of the whole 
hook) they lepvesent themsolves as having dlscoveied the “unique 
tnut “ of “ nieeluuucul aUihiy “ ; wheieas in truth the latter had ah eady 
been (Uscovri-(‘(l (imd with wliat X am afraid was far better evidence 
and moic jienelnitnvg iinulyfiiH) by Dr. J. Cox, who moioovci succeeded 
u\ so doing by basing his roseuveh on the llicoiy of two factors.'^ 

Pci haps a duo to the last nieuUoncd and gravest lesson supplied 
by these autliors is to be found m tlieu bibliography Most concerned 
liorc 18 a book of the present ivnler, “The Abilities of Man“ As 
was said in its foiewoicl: 

Tins work is the pioduct of in nay handn and muoii patience The lines of 
nwcsti gallon uere migg<Nted — and even c\ tensive bcgmnuiga made to follow tUem 
lip— over twenty yeaia ag<h »Siiioo, tlioro have been cnviicd out a long tiain of 
JaborioiiH irscaielics, eiieli bjinging, as it wore, a single stono upon a prC'Ccncoivod 
plan, ^nd hero, in tliiH "v oluino, at last, ovciy slonc is fitted into its place to btukl 
up the common nhruH'. 

Among other things, the book contained a full account of this very 
mochanical ahdity at issue. Nevortlioless, allhougli tins book is 
actually quoted in the bibhogiaphy fiom Minnesota yet its most 
relevant iiortum is wholly overlooked. The authors insert theie the 
oddest lot of the Huine wntei'n minor controvcisial ai tides 

Now hucli action of theiis would scorn to express a view that is hold 
very widely indeed, >so that once inoic wc must be grateful for the 
piosent opporUimty (o comment upon it. This view is to the effect 
that tlio work of our school luis consisted in arguing on behalf of some 
liigldy coiiliovcrsuil tiieoiein, and llmt the only concern of other 
people with it IS to join in ilie fray, foi or against 

In luUh, the work of Lins school may bo trenchantly divided into 
three poUions. The one which should be taken first is made up of 
thcoicius whicli ill c no longci seiioubly conlosted by anybody There 
is the already nienlioned piiioly nialheniaiical demonstration that, 
when the UTrad <lificicnccs aic zoio, then (and only then) the scores 
of evmy individual in every test can be divided into p and s where 
these are indeptMident of eaeli olhei ns also of all the othei s’s Then 
conies the deleinnnahon of Uie piobable eivors, not only of all these 
hut iiIbo of the iid^rnd diUtMences, l^n wo rcquuc to know how huge 
their diffcienci^H ought to he when, us always happens, the data 
available aie not the “true" conolations, hut only values luoie oi lesi 



116 


The Journal oj Murational Psyrhologi/ 


affected by the errors of samplmp: Another llieoicmj this limo 
obtained not from mathematics but from olisiirvalion, ih tliiit under 
some conditions at any rate the obscivcd tetrad difToionces (hi show 
themselves to have just this inagnitudo leciuiied foi the two factors. 
So much for the portion of the woik that should be lalcen first. 

The portion that should, on the contrary, be taken last deals with 
the attempts to arrive at uUimale ctplanalions; it includoH, for example, 
the hypothesis that (7 icprcsents a gcncial "cncigy.” Hero, iiulecd, aro 
problems that will long— -pci haps always -be infoolcd moio than 
enough with "picsumptions and a.S8UiTiplion8." Nothing but trouble 
can be expected from even approaching tlicm until after arraying and 
considering all the available relevant facta. 

This brings ua to the remaining and much the largest part of our 
woik, the one which, accordingly, occupic.s the grent bulk of "Tho 
Abilities of Man,” constituting its second part, niul cnt illptl Tlio Fuiula- 
inental Facts. Here, ns mentioned above, aro lecoided un immense 
mass of observations untiringly accumulated by very nuniorouH investi- 
gators during a great number of ycais One huge shave of these 
observations is about tho conditions under which the crilonon of leliiul 
differences is or is not satisfied. Already m 1900 the diseovcry liad 
been made that such satisfaction was liable to be diKturlK'd liy what 
weie called “broad” gioup factors.® 

These too have been made to yield both incasuiomenls and the 
probable cnors of these. Among the more iiiiporlniit that have (liy 
means of the probable errois) been shown to bo siginficunt luo Ihe, 
logical, psychological, verbal, arithmetical, and invonlivo abililios, as 
also just the mechanical ability now licmg put forward at Miniiesolii as 
new. 

Much broadci still, but no longer simply an ability, somelbing 
rather that depends on ratios between abilities, have come the factors 
0 and the still more wonderful p (sometimes written as c). Hardly 
less important have been tho negative results obtnmod m tins way, 
the evidence has been that the great majoiity of the commonly alleged 
unitary abilities, types, piofiles, and so foith arc not unitary at all. 

All such factors are originally determined in an alniost puiely 
statistical manner and therefore arc psychologically nearly meaning- 
less. But then come obseivations that do uifuso tluuu with uuuuuug 
The relations of all of them have been ascertained to nil Uic qualiLativo 
laws of cognition; and m this way the “iiocgenotic’' iialuic of g has 
been settled, not by biological or philosophical cogitation, bulj^by 
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actiml and dolailod inpiiaurempiUs of ita magnitudes and correlations 
under vaiying conditions At the same lime, investigation has been 
made of the i elation of nil these factors to the quantitative laws, to 
tho.se of span, of rclcntivity, of fatigue, and of conation, as also’ to 
puicly pliysiologicnl inlhienccH. Fiuthernioie, fiom all this systematic 
oxainiiiation of the spheio of cognition, a passage has been found over 
to the other giont aphcio of the iiiiiul, that of volition, emotion, and 
ehaiuctoi. IIoio loo a general factor has been discovered, one nearly 
or (luitc mdepcuclcut of a, and perhaps even more irapoitant still 
Those ohseivtUions mo, indeed, so piesonled as to throw light upon 
tlie factoiH involved, gouoial, specific, and group But they stand 
equally open to bemg envihiigcd fiom any othoi angle They do not 
in the loa.st dopond on any such hypothosoa as that of “energy,” but 
on llio coiiliaiy supply the very facts upon which such hypotheses 
ought to 1)C uccopti'd or lejociied, These observations should not, I 
like to think, lx* overlooked by any one mlcrcsted in any spheie at 
any laln of individiml ditleionccs They cannot legitimately, I feel 
Bine, be diniegaided by Ihose who lay claim to ougmal discoveries 
Least of all ought they to he ignoiod by those who make bold to enter 
into (he lists of controversy. 

Rkfi:uknck,h and Notus 
1. Mrcliainriil Ability Tests ” 10.30, 

2 “(ieiwial TnU'llvgeme (UijecUvnlv netpunnu'd asvd Measured ” Aincmoa 

Journnl of I'ni/t holoyy, 1001, p 2K4 

3 rositivp pioot V. ill be found for ihHlmn;e, on pp in -vi of “Tlio Abilities of Man” 

liy the jnesent wrilei, 1027 Tina (Iciiioimtialion couHists thiouEbout of 
Btriiiglilfoiwaid nmlhennilicH; lliein w not nn nssumplion or presumption 
from einl to cml. For IhoM* wlio find tho mathematics in it dillicult, it may 
1)0 menlioiird (lint ii much Himplor veicjon of it hns been clovised and will 
sboitly be piibbaUed (m “Niilme'') by tUc well knos\a mathematician, 
Piofessor I’ihkrio 

4 Ihtlish Jounml oj Pt,ifchohg!/, \o) V, 1012, p 82, formula (8) The simpler 

formula eniptoyeil by llicm liikcn no nccoiml of the dominant influence of 
llio samiiiiiiK ciiuiH of till* enii (‘lation 

6 Ibid I’ fiO, the Iiuch in iliilicH 

fl ‘“J'liP Abililios of Man ” Hy llic picscnt wutci 1027, pp 135-110 

7 ‘‘Morbiiiui'iil Aptitude ” , 1 . W (V, l‘)2R, MetUuoii and Co 

3 Dio Koiielulion /wihchen verHchiedencn RC'istipoii LoistuiiEsfaiiiEkeitcn 
’Aedurhtjl Jm tNyWuifeoii', Vol Xl.lV, 11)00, ]i 103 



A REPLY TO SOME RECENT CIUTIClSIvlS RY 
PROEESSOR SPEARMAN 

IL D. CARTEll 
UnivciRily of Miiinohol^ 

Since scientific eontiovorsios fipqiicntly lend to clnrilu'ution of 
iesues, a comment on Piofcssor Spcdiniun’fi I'Ccrnt ('iiticiMiis' of my 
attempt to analyze the natui’o of mocluiiucal alnlity* may he lu ouloc. 

His main criticism was direclcd aKainst niy uso of the ml orcolumiuii 
coiTClation method as aeiitcnon fov tho prev^eiiee of Uic fiumlmv 'Two 
factors," g and s. He oharactci'izofl this niolhod as obsolete, yet in 
bs book, "The Abilities of Man," on papto 1311, he has tv livble of twenty 
penes of data which were analyzed by tliiH niolhod, and llie rohulls 
were used in support of his theory. This sufiResla that oven though 
the method may now be labelled ns "ohsololo," iicvci I Iiele.ss it is 
peimissibie to coTitimio to report results secured by that method 
furthermore, it is to bo icmembeied that the ncwci' leUiul-dilToreiice 
method of analysis mathomalicnlly c\picss<‘s the Siiine fundnineiital 
relations. In ray own work I recognized this fact and accoidmgly 
analyzed my data by means of both mclhod.s, diacovering tluiL tho 
trend of results was tho same. This wa.s inovilable in (he very nature 
of things. Since I employed tho letmd dilTeroncc moUiod in adiHlion 
to the intercolumnar cori'clalioii niothorl, I do not believe (hat ]*ro- 
fessor Spearman was justified in his main cntioiKin 

Mr Spearman also cnlicizod my woik by Btaling (hat my tallies 
of correlations did not satisfy the only coikUIiou under which the 
intercolumnar criterion is applicable. It is tiiic ho luia a criterion 
for the exclusion of ceitam pairs of columns, which is aibilrmy, and 
not wholly free from ciitioisin. After rending Thoinp.son'K mathe- 
matical criticisms’ of the ‘‘exclusion cri tenon” I did not legaid this 
criterion as essential, but I decided, noverthclcss, to apply it to rny 
mam table of intercorrelntiona. It was iiiy misfortune, however, 
to take this ciitenon diiectly fiom Piofessor Spoaiinan’a 1914 paper,' 

* Speaiman, 0 A Tiuce to ''Dniking in.” Journal o / Sduculional Psyclwlogv, 
Vol. XXI, 1030 , pp lio-lll. 

* Carter, H !>.• Tho Organization of Mechanical rntelligoiiue. Jownitl ft/ 
Geiidic Psychology, Vol. XXXV, 1928, pp. 270-286 

’Thomson, G II.. On ilio Dcgico of Poifcotion of Iliornruliu'al Older umiiiig 
Correlation Coefflcionts. Biometnka, Vol XII, 1010, pp 355-300 

‘Spearman, C ; The Theory of Two Fnetoiii, Psiicholoyieul lieuisiu, Vol 
XXI, 3014, pp 101-116, (See page 112 ) 
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111 which he hniiwlf inissliiU'd it I should have secured the method as 
correctly Bliilcd hy Spcariimii in his 1912 paper ‘ The ciiterion, 
tliei'cfoio, was miproiicrly applied, which led to my incoirect statement 
that all GohinuiH of my Table III satisfied it But leccntly, after 
loading his cnlicism, I apphod the criterion again, this time correctly. 
Of tho (Mgiit columns in Table III, foui satisfied it, and four did 
not The aveiage correlalion between all columns in the table was 41. 
The avciiige of the, six mtcvconclatioiis of the columns which did 
satisfy the critei ion was 119. For all othci pairs of columns the average 
inLorcorrahitioii was '12. Correct application of the eiiterion is 
thus shown to have no important bearing on the results. 

Profcssoi Hpeaiinan also criticized my paper because his own 
icfcicnces to one, published article and to two unpublished reports 
in hi8 “Tho Abilities of Man“ wore neglected Ho claims that those 
invcsUgalions reveal inecliiiniciil ability to be umelatecl to g and to 
involve a group factor But my aiuilysis showed oveilappmg group 
factors. It is to bo noted tliat my results differ from those quoted 
by Spearman m omphasizing group factors rathei than a group factor. 
Thus it would appear that the Minnesota Mechanical Reseaioh 
Project inake.s an additional contribution to previous knowledge 
dealing with the abilities of man * 

'Spoiu'inan, C. mid Hint, U GBiipiftl Ability, Its Existence and Niituro 
llriUsh Joianal of Phiiiliolofii/, Vnl. V, 1012, pp. fil-8‘1. (See page 5S ) 

’I'ateiflon, 13. (I, Klliott, H M, Anderson, L Dewey, Toops, H A., and 
Iloidbrcdor, E "The Minnesota Mcehmncal Ability Testa " Univeisity of Min- 
nesota Press, H)3U, pp. 1-010. See especially Chapter II, The Thcoiy of Unique 
T’raita; (Jlmplcr XI, Tho Oigivniration of Mechanical Ability, Clmptev XII, 
Mcchaiiiea! Ability ns a Uniiiuo Trait 



STUDIES IN IIANDEDNIWS: Ilf. KElyATTON OF 
HANDEDNESS 'J'f) SFEEOH 

U, II OJKMANN 
.State Uiuv(*i‘iih of Iowa 

In tins ftiUclc data, will l)C imtspuIccI iclalivci Ui (lu* pKiblctu of Llu' 
cHect pioduced upon the Hpcwh function by InuniUK Ii'II-IiiukIlmI 
children to write with the iifilit linnd For tliiH iiivc'diKalion two 
groups of subjects weio used. In the unsoh'clcd groiip of fivi' liuiulred 
eighteen pupils used in the invosligiillon reporti'il in the lirnt luiiclo 
of this senes of studios in handedness there weie twenty-seven pupils 
who weie diagnosed to bo left-handed by the lochnuiue ([('sciihed in 
the fiisl papci Seven of the tu'enty-seven ciise.s wrote with thi' light 
hand These seven cases constitiUo the first group of de.xlro.siniMtrals' 
used in the piescnt invesligalion 

The second group oi dcxli'OsiniHtralH was oliliimed as follows: 
In the city from which the randmu Riiinplu of live lumdred eighteen 
pupils was taken from Gindo,s III-VIII there was a (nlul number of 
1571 pupils in these grades. It was asstlined that if the name.s of 
all the pupils who performed oiio or inoro of such uelivilie.s as using a 
pair of scissors, throwing a ball, and dealing cards weie olitained, 
several dextrosinislrnl cases would bo si'cured. Aoeonliugly, each 
teacKov of Grades III- VIII was askud to make, tUvee lists of uiuives; 
(1) A list of the names of all the pupils who used a pair of scissors with 
the left hand, (2) a list of tho naine.s of all the pupils who threw balls 
with the left hand, and (3) a list of the nanrirs of the pupils who tiiought 
they could deal cards bottei with the left hand than with the right 
hand. The purpose of this request was made elcav to eaclv teacher 
It was pointed out that it was dc.sii'ablo to get all the pupils who uaoil 
the left baud for the activities mentioned; and that, Hierefoie, Ihi' 
teacher should include all doubtful cases. It was explained that il 
would make no difference if too many cases were ropm ted, since each 
case would be carefully tested It was also explained tliat it xvould 
be no rcfleolion upon the teacher’s ability if too iniuiy cases were 
reported. Each teacher responded cntliiisiaslicivlly, Fioin (lie list 
of names s ubmitted by tho teachers the ruunc,s of lho.se studcnls 

iThis term was adopted by Ikllaid Kuiitdinlilv iiiid >Sjh*i'o1», Joinniil of 
Experimental Pedaoogjf, Vol I, 1011-1012, pp 208-310, and will bn iiHeil in Huh 
ropoit to designate a lott-bandod individual who has loami'd lo wiilt* willi the 
light hand 


120 



Studic'i in Handedness 


121 


who had bo(*ii incUKlod in iVio iinHeleol.cd group were checked The 
pupils whose luinios reinauird weic carefully Icslcd. By the use of 
tins pioccchn-c sixteen cnaea* wore secured in which the coiribmed 
scoio oil llie five uniinanuiil handedness tests was negative four or 
lower and iii which the light hand was used for wiitmg. These 
sixteen cases coimtitiilo the second group of dextrosimstrala used m 
tlie piesejit i lives ligation 

In luhlilion to llie, uniiiiaiiual tiiid bimanual handedness tests 
each doxtiosiiuslral was given three speech tests: 

1. Ai(icidn(ion 7’c.si. —This test consisted of n senes of sentences 
which were road aloud hy the sulijcet while the experimenter checked 
oil a ipcoid sheet piovided for the purpose those sounds that were 
made incoriectly. 

2. Spontnneous Speech Tesl — Tlic subject was shown a picture 
anti was asked to describe aloud what he saw. The experimenter made 
detailed notes of any apeech dofocts 

3 Oial Reading Tesl — Gray’s "Oral Reading Check Tests” were 
used, A lecord was kejit of tlic time required to load the whole 
selection iiilher lliaii each paiagraph. This modification was made 
in Older that the expeiiinonter might direct his undivided attention 
to the euoiH nnule, siiioe an accurate record of the cirors rather than 
of the rale of leading was tlesiiod. 

In addition Ui the dula gathered by means of the handedness and 
speech tests, the paieiiLs weio inlei viewed to obtain their judgments 
conccining tho handedness of tlio subjects and to obtain the facts 
relative to the lusloiy of the subjects’ speech and writing habits. 

The data for Iho two groups of dextrosmistiBls, twenty-three 
cases in all, aie incsentod in Table I Tlic first seven cases aic the 
doxlrosinistials of the unhclcclod group of five bundled eighteen 
pupils 'fho cases in each gioiip arc arranged according to the grade 
reached in school at the liino this investigation was made. Since the 
investigation was made .shoitly after the second semester had begun, 
the ago of the subject at the bogmmng of the second half of the 
school year was used foi tlic data in the column headed “Age ” The 
unimanual test .seoies arc given in toims of unit scores, (ffor a defini- 
tion of unit HooiTH see tlie fust jmpei of this series ) 


'The piajiei lion of di'Nliosaiistiah ia the uiwlpctcil gioiip la 0135 ± 003 
Hinco Bixtci'M (’iisc'H foumt in the miiiiiiiiMg Rioup of pupils, tho piopoitioii is 
01.52 .L- 003, 'I'lie (lincii'iiro liplwrcii llio Uvo piopoitioiis is 0017, which is less 
limn till' piolmhtr l•llnl of pilliei piopoitioii 
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A study of the ago8 of the subjects and the grades reached in school 
shows that one of the subjects — Subject 784 — was seiuously retarded 
111 her school woik. 'I'his subject had an IQ of sixty-twoi and was 
afUictcd with a mild epileptic tendency. According to her third 
grade teacher, these fnels accounted for her extreme retardation 

A study of tile combined unit scores on the iinimaiiual tests shows 
lliot all the oases scored negative four or lower and arc, therefore, 
definiti'ly left-liandi'd. This diagnosis was corroboiated m every 
case by the parent’s judginont 

A study of the speech lest results shows that in two cases, Subject 
407 and Subjeot 03G, speech defects were present at the time of the 
mvostigalion. Subject 407 failed to articulate accuiately the "b,” 
"p,” and ‘Mz” sounds. IIis (Uflicully was diagnosed as faulty articu- 
lation. This subject showed no tendency to stutter Subject 636 
had a mild lisp She substituted the "tli” sound for the “s” sound 
No additional speech disturbances were detected by the spontaneous 
speech lest oi by the oinl leading test. 

Tlio results of the speech tests were confumed by the interviews 
with the parentH. According to the paionts’ rcpoita only Subjects 
107 and 036 had bpeccli defects at the time of the investigation. 

Subject 104, at about two yunrs of age, when aha first began to 
talk, sUittered noticeably This speech disturbance continued in 
mild form until she reached the third guide The disturbance then 
disivppearod No speech defects were present at the time this investi- 
gation was made. The fust guide teacher attempted to teach the 
subject to uhc her light hand for wilting and was successful without 
much ddficulty. 'L’hc niotliei stated that this was due to the child's 
tompomment The child was easily managed and the teacher, there- 
foie, had little dilTiculty m stinting the child to practice the use of 
the I'jglit hand in writing Since the fiisfc grade, tiie use o-f the right 
hand for wilting had been consistent. The parents reported that this 
training did not iiicieiiHC the seventy of the stuttering. *^>1 

Subject 10 developed a very marked case of stuttering when he 
was about two ycais of age This disturbance lasted foi about a 
ycai, aftci winch it guulually disappeared He had developed no 
speech dif{tuii)aiicc.s smeo that time. Dining the pie-scliool period 
Iho subject used the left hand foi writing. Under the influence of 

•Tlio wiiUir iH iiali'Iilcci lo Llic scliool nutlioiitics foi this infonnalioa 'J’he 
Uinol-Simuii test wna UM>tl 
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the first grade teacher, who licatcd the cluld’s diflioullH's .syinpatholi- 
cally, the subject learned to wiilo wiUi llu* nglit luind No effect 
upon the speech function of the Irainiog in the use of the right huud 
for writing was observed by the piirenls 

Subject 676 stutleicd sliglitly when .she first learned to talk. 
This disturbance had disappeared liy the (ime, the, ehild was three 
years of age. No speech dialurbiinces had devi'hrired since that tune 
The subject used her left hand for writing until slie eiilereil llie second 
grade Her second grade teacher persuaded her to irnudiee writing 
with the right hand The to-acher encouraged llie ehild and eseiciaed 
considerable patience in helping her ovi’i-coinc' the diniculties Knice 
the second grade, the subject bus u.scd the iiglit baud for wnling. 

When Subject 703 was about three years (tf agts tlic mother 
attempted to train her to peiforiti llie, iiriiicipal UMinuimial aelivilie.s 
right-handed The child begun to stutter The iiiolher hecaine 
alarmed and, on the advico of a. neighbor, diHcontiuvied the training 
The stuttciing disappeared about » year and a half later and did not 
appear again, When the child entered the fust grade the p.uejits 
insisted that the tcachei train the child to write wilh the light hand. 
The teacher and the paicnls treated the cluld’s (lilTicullieH syiiipatheli- 
cally. No effect upon the speech function of the tiaining in writing 
with the right Imnd was observed. 

The foregoing data may bo summarized thus' Two of tlu* twenty- 
thiee dextrosmistrals evidenced speech dofccls at the (one they weie 
tested. In the.so two cases tho speech disturbanci's aiipeaied when 
the child first learned to talk. Pour of the twvuty-llnci' hubjects 
were reported to have had a speech disturbance at hoino time iirevious 
to tho investigation. In these caseg no conneetum between iho liain- 
ing in using the right hand for writing and the sjieecli ihsluihanci' 
could be established. The rcmainuig seventeen de.xlrosiniHlnils had 
developed nc speech defects at any time. 

Before an interpretation is made of the above data two additional 
facts relative to the history of the subjects’ writing habits must la* 
noted In all twenty-three cases the intensive training in llii' use 
of the right hand was started after the speech liubils had Ix'Coiik* well 
organized, that is, after the subject had entered the liist grade. In 
two cases punishment was used by the teacher to liam the child to 
write with the right hand. The second grade teaclu'r repriinaudod 
Subject 619 severely and punished her by slapinng the iiinuls, slialimg, 
etc. The child had considerable difficulty m learning to writ!' with 
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the right hand. Ilor oiuly attpmpls produced writing m mirror form 
Tlic trcnliiionl .she received by lier second grade teacher made her 
nervous and iiiiliilile hut did not, accoiding to the parent’s report, 
affect her apcecli. Subject 692 was pimislied by slapping the hands 
and by shaking. IIis fiist grade teacher frequently sliapped the left 
hand to the body to picvont the subject fiom using it during the 
wiiting period. Tliis lieatmont made the child nervous but did 
not produce a spoecli disUirbance. 

The tiala pn'.s('nted m this paper arc not subject to any serious 
limUatioii.s. In all twcnty-tlireo cases there is no doubt concerning 
tlio haiidodiioHH of the subjects or concerning the apceoh disturbances. 
The data form un impiossive array of facts the mtcipietation of which 
will be iiricfly consideied 

These data tend to show that in training a left-handed individual 
to AViite with the light hand, the handedness of the subject is not a 
suflicieiit condition to produce a speech disturbance. It appeals 
to bo the excoptioii lalher than the rule for a speech disturbance to 
be pioducod liy training lefl-liandcd nulividuals to write with the 
light hand Any explanation for those ca.scs in which a speech dis- 
turbance follows tlio shift from the left liand to the light hand must 
thcrefoiu ho based upon a factor or group of factors which operates 
only in exceptional cases. An explanation which is based solely 
upon the neurological basis of lefl-haiulcclncss is therefore inadequate 
The nervous byhteiri is far meue flexible than is implied in such theories 
The vuuous motor and speech aioas in the cortex are not localized 
to such an extent that it i.s iiiipo.Hi.ible for a left-handed individual to 
leain to write with the light hand without di&tiiibmg the speech coor- 
dinations Most left-handed individuals who learn to write with the 
right hami do not develop speech disturbances 

It i.s, of couiKO, ijossible that in training a left-handed child to write 
with the right hand, faclor.s other than the conflict between the right 
and left liaiul may bo brought into play to produce a speech disturb- 
ance For ('xainplo, if the subject is emotionally unstable nnd is given 
no special caic, or if the teacher employs a method of training that 
produces a scriouH mental confusion on the part of the subject, the 
pvohivhiUty of producing a K\icecli disturbance is much greater than if 
an attempt is made to treat the child’s dilliculLics intelligently 

The data prewuiled in this study show, however, that under ordi- 
nary conditions the ilangor of producing a speech disturbance, after 
the speech habils liiwe been foiincd, by training a left-handed child to 
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write wilh the I'lght hand ib very aliglifc. The neivoiH system is 
auifiovently flexible to allow an mdivuluiil luvviiig a sliong lefl-hnmlctl 
tendency to bo trained to develop the complex coordinations icciuircd 
for writing with the right hand ivilhoiit hruiging aliouL a tliHlurlmnco 
in a closely related sciics of fino coordinations such ns arc involved in 
speech. 



THE CONDITIONING OP OVERT EMOTIONAL 
RESPONSES 

HAROLD ELLIS JONES 
Umveiaity of Cnlifornia 

TJie lal)oiaLory iccorcl which lias been chosen for this report 
dciivcs inlpi'CHt fioin ll»o fact that it duplicates, in a human subject, 
and in a BiiiRle cxpcijiiicnt, many of tho typical phenomena which 
have been described in llio literature on conditioned reflexes in the 
lowoi animals 

Tlie experiment wa9 conducted in an isolated chamber, on a plat- 
form miaul with Lhiii biass strips, tho strips were one-quartor inch 
in width, separated by quailer inch spaces, and connected alternately 
to the positive and ncg«'tive piimarics of a Porter induotoiium. Foi 
greater quiet, a fifty dv. timing folk was substituted for the reed 
makc-bicak of the induclorium Cure was taken to adjust the second- 
ary coil of tho mductoriuin so as to givo an clccfcrotactual impulse 
restricted to a range of low intensities; the stimulus value may be 
desciibed ns a mildly uucomfoi table “ tickle ” inther than as a ‘'shock ” 
Tho subject for this expoiimcnt was Robert B , a child fifteen months 
of ago, of a markedly stolid and apathetic disposition, able to walk, 
and possessing ii speaking vocabulary limited to fewer than five words 
When lie was biouglit to liio laboratoiy a group of toys on tho plat- 
form attiacted Jus attention Ho sat down m the middle of the plat- 
foim and icihiuikhI contentedly at play when left alone in this 
Situation. T'wo ()l)S(‘rveis, concealed behind a one-way vision screen 
three feel away, lecoi ded the child's overt behavioi m as great detail as 
was possible by a siiiiiile oliservalional method. The mductorium, 
iiattcrioH, and a systmii of bolls and buzzers, were housed m an appa- 
latiis box m a coinci of the room. Robcit’s oiiginal leaotion to an 
olcctiic boll, wliicli was sounded foi approximately two seconds, 
could be doscrilicd as "mild intncst,” shortly becoming “indifference " 
After four ropotiiiions ho no longoi gave any observable reaction to 
this auihloiy stimulus. Stimulations weic now given, at inteivala 
of about fifteen si'conds, associating the hell with the elcctrotactual 
fetiniulns Aftoi two .seconds willi the bell, the mductorium circuit was 
estttlihshcil, aiul aiuiitoiy and tiieUial stiinuli were continued together 
for tliieo seconds. 'L'lie application of the tactual stimulus (felt eithei 
on hand oi foot, oi both) lesultcd in a prompt shifting of the skin 
areas which were m contact witli tho conducting strips, m each case a 
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slight but imtnistakftblc slaitlo icaciion was icgiatcwd, ii(!coin]>iuuc(l 
by cxpicssional changes such ns a hox-sliapi'd tiioiilh, or a jnickoring 
or pouting of the lips, and ficqiiontly by vocal inunmtrs or a slight 
whimpei'ing ■which consed at the end of the stiiiiiilatioii pciiod lu 
the periods between slinuilationH, llobcrt played quiet ly with the 
toys, and showed no overt uvdicalioiiH of a peisisting aiipieheiimveuess 
01 emotional upset. After three imiciatums with the primal y 
stimulus, the boll was sounded alone; foi the eiiauiiiR live Htinmlal.ionH, 
startle reactions were lecoidcd which wcie indistiiiRUishable from 
those elicited by the primary sliimilufl; the second observer, who 
of course lieaul the boll, but had no direct ineiins of knowing when 
the elect! 0 tactual stimulus was used, judged (hat Die associations 
with the unconditioned stimulus were being continued through eiglit 
(instead of tlnough merely the fii.st three) hiiccc.‘'H 1V0 Irialh 'I'wo 
stimulations by a buzzer were also ofTcclivo in giving slaille leiicliona, 
although with appieoiably greater delay A Miudl huud boll, of very 
different timbre and frequency from the conditioned almuiluH, elicited 
no reaction. In the following liials an extmeUvo inhibition was 
established to the bell, and six leinforccmoiils were given; in five of 
these, the cloctiotactual stimulus was icccivcd on the. foot and not 
on the hand, and it was noted that the stimulus to the foot .showed a 
reduced effectiveness. At the fiflictli Inal, after eighteen pu'senla- 
tions of the coiidilionocl stimulus alone, a (J-ll was still lue.si'iit: The 
subject moved his foot sharply, turned liis Jioad away, and vocalized 
in a manner interpreted as "scolding ” 

After twenty-four hours, the child was again buiugUt to the labora- 
tory He entered the chamber readily, seated hiniself on the plaL- 
form, and began playing with blocks At the first pieacnlation of 
the bell ho paused and listened, at the second he started slightly and 
murmured; at the third he began to whimper, and showed overt 
movements similai to those which had been elicited at tlio beginning 
of the expeiiment by the primary stimulus For the Inizzor, flibtiii fi- 
ance was less marked, and for the hand bell only nttcntioii i espouses 
were recorded A small piece of zwieback provided Itobcrt with an 
activity which foi the time being inhibited overt ro.spoiiscs to the bell. 
In the later stages of extinctive inhibition of the oveit rchpoiwe, it 
was noted that "implicit” responses occasionally still ociMirved, as 
illustrated by pupillary dilation or by flushing.^ 

' A fuller mstrumontiil study of condiUonod reactions has lieon repni tiul in 
Jones, H. E, ; The Eetentiou of Conditioned Emotional Ilcnotions in Infonoy 
Joarnal o/ Genehc Psychology, Vol. XXXVII, 1030, pp .1S6-^108 
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AIlcv Sftvftjity-Uvo houifi, Ihe fusl fipphcaiion of the bell resulted 
m nioiiieiilai’y ovymR, ou the second he eiied and withdrew Ins hand 
slowly; on the lliivd ho showed a gcnoializcd bodily startle reaction, 
These were tlio most iiiiukod icsponses which were obtained during 
the entile kcucs, and the experiment wtia discoiitiimcd in order to 
ftvoid fuilhei emotional diBliubancD. It should bo noted that the 
conditioning was dwiiimily to tlio bell and not to the platform, in the 
miorviils bi'twM'u stimulations lie played about freely m contact with 
the biass strips, and Bhowed no hesitation in touching them Thcie 
was no coiulil lonmg iigamst the total situation (of cnteriug and playing 
m tho room), and no iiidicatioii that the expeument pioduced any 
harmful caiiy-ovor m the child’s normal play activities 

Opporlimilics wcic lacking to test the latci course of the C-E, in 
view of the mildnesM of the pnmnry stimuli employed in the original 
conditioning, it nuiy lie expected that the C-R would be short-lived, 
the effect of telephone and otlici hells would be to inhibit rather than 
to maintain the icaciion. In conducting an experiment of this natuie, 
it is obviously desirable to holeot a child of a stable make-up and to 
proceed with caieful allentioii to tho possibility of psychological 
damage. At the ago under considoialion, and with properly super- 
vised conditions, it m fair to say that the cxpeiiment involves less 
iisk of cmolioniil upset, oi of any peisistmg ill effects, than an equiva- 
lent amount of lime spent m a roiUmc phymcal examiimtion. 

For purposes of classroom iircseniation, the writer has found it 
useful to sumiuiuize the toiegouig data in the form of the following 
tabic: 
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Stimulation 

Stimulus 

Overt 

I'roccss 

number 


rpiponso 



Cuirciit 

+H’ 

Hfiirlh' leiictioii In uncondi- 
tioiinl Htimiiliis 

1-4 

Bell 

-1- 

IllWSllglllOiy K’llCllOtiB 

6-10 

Bell 


Ncgnlivc iiilnplnlion 

11-13 

Bell, ciiuent 

+*1' 

('oiiditioning 

14-18 

Dell 

+-1- 

Klarllc TcuvlKUi In randw 
IioikhI stllllllhlK 

19-20 

Biizr,or 

1 

1 

h 

Cieiicrtili/atKm of the (Ml (u- 
riHliftdon of excitrilioii) 

21 

Hand boll 


Spcciiilirnlioii of the (Ml 
((liHcriHiimilioii) 

22-24 

Bell 

, 


25-26 

Bell 

- j 

Kxlinclive iiiliibilion 

27-32 

Dell, cuircnt 


UeinfoM’('meiil 

33-60 

Dell 


lle-t“iliibli'‘lie(l C-ll 

AfliOr twenty-four hours 




61-64 

Dell 

- to 

KiinniiaUoii (‘/j 

65 

Duzzor 


66 

Band bell 



67-00 

Bell, food 


Teni|)ftiftry evleninl iiihibitioit 

01-62 

Bell 

•h 

03-65 

Boll 


X^ntmeliMniiliiliilioii 

After seventy-two hours’ 




05-70 

Dell 


H|inii(iitieoiis leeoveiy (dis- 
iiihibiliou) 


CERTAIN AMBIGUOUS TERMS IN EDUCATIONAL 

PSYCHOLOGY 

STIiPIIKN MAXWELL COREY 
Dp Pnnw TJmvpisity, Grconcaatle, Indiana 

It IS di/Ilcull to muloj stand wliy educational psychologists should 
bo 80 httlo concorucd with the terminological status of their field. 
Many woi ds, if wc may ] udge liy tho frequency with which they appear, 
are intended to lie cxticmely meaningful, but what they mean is vague 
Yet textbook writoia state dogmatically that a ''habit” is this, or 
''learning” is Hint, without appaient realization of or mtorest m the 
fact tliat thr.se terms moan one thing to them, and something else to 
the majority of Ihcir icndcis Nor docs it seem wise to smile at this 
dipagiconienl, and contend tliat it is after all just a matter of words, 
Aliy scicncR must depend upon luuRuagc for its development, and the 
value of a HOionco i.s hugely a function of the precision and accuracy 
of the woids that symliolizo its meanings When words are used 
loosely, ''tho mind approaches a condition whcic practically every- 
tliing 18 a thing-um-hob or what-clo-you-call-it ” From a ceitain 
point of view, educational psychology seems to be m some such state 
Too many of tho technically used woids aie indefinite They are 
awkwaid tools for thinking and treacherous as well foi their ambiguity 
leads to confuHion, and an inability to distinguish between separate 
factors 

In an attempt to make Lins ciiticisin more concrete, some of the 
moiinings iittached to the word.s habit, learning, mtelligenoe and 
inatincl are presented. These are four of the oldest, seemingly most 
icvoicd, and certainly most widely used teims in educational psy- 
chology Volumes have been wiittcn conceimug each, yet none 
coiivey.s a precise meaning Each is understood, after a fashion, and 
finely interpreted All waters use tho same symbols, but the ideas 
for which the .symbols .stand aio practically indetennmable. 

To iUustrale, con.sich'i’ the term ''learning ” Piobably no single, 
.so-callod loehmeal word, is luoic widely used by men in the field of 
education, Tliere me learning curves, leaining peiiocls, the learning 
process, psychologies of liMumng, and so on almost indefinitely To 
assume, however, that ivntei s on these subjects have in mind a common 
idea would clearly demonstrate a lack of acciuaintancesship with the 
facts Tho word "loiirnmg” is a standardized symbol repieseuting 
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an unatandardizccl concept, It is tlefiiied hy edueiilioiiiil pHycliologiats 
in one oi moio ol tlic five following ways; 

1 Learning afl giowtii 

2, Learning as ByncjiiyiTionfl wWi mwiwvizmg* 

3, Leainmg icpicaonting anymore or porinunont cliangi' ni lirliavior not 
du^ to matuialion 

4, Learning as Ryoonymous with ediinilion, or upinnurliing n Roul 

6, Lcaiiiiiig as coiiueetioii-foiiiHiiK. 

Kale Gordon ia one who advoculoH the c<u\vopU<u\ of hMU'niu^r uh 
giowth.' She wuios of the gvowlli of motor oa\>aoiiu-rt ainl iuHtiuctH. 
Learned behavior is bchavioi that has ^^giowu” to lio moro elahoiafcc 
and anbUe Giowth is always m lUo divccUoii of gi eater complexity, 
so that all change is not growth, and hence not learning Learning 
takes place only m the transition fiom simple, to complex, Judd, 
Koflfka, Biihlor speak of the *'growtli” of the niiiid, Ihe "'giowth'' 
of certain capamtics and abilities. They me disciples of llu' develop- 
mental typo of ecUtcalional psycliology Kvery thing m growl h, a 
rounding out, **clo«uio.’^ 

To another group learning nioiely means ineniorjy,ing ^Sea^^hore 
devotes an entire chapter bo what ho calls the loniinng pi nee, ^*1, but ho 
diBouescs only memory.^ Pjllsbury iiHsumos a Hiinilar point of view 
when ho states that “learning is no moro than the fornmlion of iihsooui- 
tions.“^ This conception of learning was quite e<unni<)n among all 
early psychologists, and was clearly cxqjuunchal a ml (hweloped hy 
Ebbinghaus Eecenlly, however, some writers have lo 

distinguish between mcmorijonig uiicl learning, nuuntiuniug that the 
former is prc^einmently a function of the cerebium, wliilo haiiiiing is 
palajencephalic. 

Some psychologists, in an attempt to render an alLmcUmivo defini- 
tion of learning, state that it is compiised of all more or loss jioniuiueiiL 
modifications of behavior, save those whicli come wholly from matin a- 
tion,^ Accoiding to this definition, learning lakes place when one 
loses the ability, once possessed, to rocitc a parlicular poem. Chilvin 
writes, “Tho Icarnmg pioccss may chiefly bo doscrihiHl m i(s most 

^ Gonlon, Kate ” Educational Psychology ** P 

“SeFishoic, 0. E.: ‘^Intiodiiction to pHychology.’^ (Hinp. 13 

* Pillebu ry, W , Ik ; “ Fmidam on lals ci C Pfty cUologv V %\{] 5 

^Cameron, E 11 • Educational Psychology “ P, lOn T.caniuiR m 
broadest Beiific coinprisoR all modifications of behavior except lliOHO whlih icsnlt 
fjom puicly physiolugical clmnges, iukI Hiohc which coino wholly fiom iiu'U'aHcd 
maturity 
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gontiial lonns iis the inodificnlions of the reactions of an oigamsm 
through cxpciicnce lie does not lulc out physiological or maturity 
changes, piovicled tliey be offccLecl or influenced by experience. 

To other writer.s, Icaining has always had philosophical implica- 
tions CJlapuvede, in a section of his book where learning and educa- 
tion aie used iiiteichaiigeixblj'^, writes, "It [?] is not merely ii matter of 
exeici.smg the inlcslligeiice, of furnishing the memory, but rather of 
ducoting I he clmmeler upnglit, of stimulating zeal, and of developing 
the will and pei.sniiality Tins concept of learning as a change of 
bcluivioi ill a certain diieclion, towaicl a goal, is rather common 
Lcniiuiig IS cnllotl "piolU from experience,”* it requires evaluation, 
and tlierofoie cannot be Btudicd solely with the methods at the dis- 
posal of psychologisls. How can psychology decide whether a certain 
change in behavior ropiesents piolil or loss? 

Again, learning i.s not only consideicd ns a modification of behavioi, 
but also ns a modificalion of neural conditions. In the face of our 
relative Ignorance of its nature, many writers in education and psy- 
chology (lofmc learning m terms of the changes in the neivous system 
winch accompany il 'I’Koriuhko’s btatemont that '‘learning is connec- 
tion forming”' caiiicd weight. Starch rcpiodiicos the thought in 
these words; "PiobaUly all fonns of learning can be leduccd to one 
relatively solioinatic typo, lleception of impressions through the 
senses; assimiltilion, analysis, and combination of processes m the mind; 
and rediiection of impulses to produce a reaction; or m brief, stimulus, 
association, and lesponso."' Galea wiitca sumlarly, ‘‘learning con- 
sists in lh(' stiengUioning and weakening of connections between 
Bitiialion and roaponhe.”*’ 

Tlio natural le.siilL of this lack of agi’cemont as to the nature of 
Ie.aiiiing is apparent The iiitcre.stcd and intelligent layman thinks 
that cilucators don't know what they are talking about, and if they 
cannot agree among themselves as to what learning is, how can they 
loach Ins child? IIis reasoning is not easily criticized, and the lack 
of agi cement is all the inoie confusing because it is not merely one of 
woi ds, but involves ideas ns well 

* Clolvm, K H *'Tlu' LPiiinuig Piurcss ” P. I 

® Clapiiii'tlc, P!(l "KxiX'iimmUil PeildKogy.” P fiS 

Coh'mim K “ Grueiiil laUoituction to Psychologv ” P HO 1« 
ollioi ivoids, tme pniiit fiom cxpcncnco (l('iiiiiiiig) must lopicsent a tunotional 
chango in Iho nervous svsti’iu 

^ Htaich, llanwl "Kilwcalional PsyrUology" (Revised Edition) P 127 

‘ Galer, A. I , ‘‘Psyoliology for Students of Education ” P. 238. ^ 
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The concept of " liabit" is in much the fiiuiiR protlicn incut. There 
are almost as many clifrcrciit icloiis as to the mitiin* of habit as theio 
are outstanding cducatois. Some attach a diitcrcnt meaning to the 
word each time it is used. Obviously, like learniiifj, halnt formation 
may bo and is consiclorcd fioin two liusicnlly diiTeient points of view, 
neurological or behavioristic. Many authors make tins dislinctum 
clearly, but m their subsequent use of the lerin, no hint is given as to 
which side of the coin is being considered Warren defines Inihit as 
both, a "process of forming conncctioiiK in liie nervous aic"' and as 
“an individually acquiied and stcrcolypcd senes of lesponses oi 
thoughts.”* Is each of these a habit? Is a habit only pic'seiit when 
both conditions aie fulfilled? Do the two occur concoinilanlly, or 
does it make any difference? 

More pertinent to the subject, even among those autliois who 
attain nncl consistently hold one point view, ncuiologieiil or behuvior- 
istio, there la a lack of vmnnunity as to what a imlnt is. Home, for 
example Judd who bpcaks of "Lcniniiig or habit forninlion,”" ennsidor 
the term as equivalent to Icninlng. Wiuilovoi is leiuned is llieiefoio 
habitual On the othei hand, habit la thought of ns .somelhmg which 
18 largely automatic, mecliaiiiciil, etcrcotypcd, k'ss diqicndenO upon 
consciousness. Pillsbuiy defines habit ns a teiidmicy, “llie tendency 
of all movements and of mental opcrulioim whicli involve little or no 
movement to become mechanized.”' Or, in the woiils of Jiune.s, 
“An acquired habit is nothing inoic than a new pathway of diHchurgc 
formed in the brain, by which certain incoming cmieuts evn <iftr) 
tend to escape.”' The main concern of this gioup is the detm’iimmtion 
of a basis upon whicli to distinguish habits from instincts, 

Nor have the pos.sibihtics for a misinteiprotation of tlie word 
“habtt” been, exhausted. Many writcia civnnot use the leim wilhoiii. 
involving ethical considerations. He is habitually neat, or honest, oi 
cowardly, or courteous, he has “good” or "bad” habits. Accoidmg 
to the many followers of Thorndike a habit is a specific, luiloinatic 
response to a definite situation, but the extent to whicli wo iiio said 
to have the habit of honesty is a function of the nuuibei of ivuU’bj 
different situations to which wo respond in a (loucmUi/ honest iniumm 

1 'Warien, Howard G.. "Eloiucute ot llunmu rByfiholouy." ?. ‘2&3 
^IbidtV. 403 . 

' Judd, 0, n "Psychology of Secondtuy I'ilucnlion ’’ 1>. fi.l 
' Pillsbory, W. B,’ "Education as tlic PsychologiaL Hcch U.” P W) 

‘James, William "Psychology,’' Bnefor Course. P 13 1 . 
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There are racial habila, specific habits, general habits, mental habits, 
and moial habits; in terms of the nervous system or in terras of 
behavior To one n habit may be anything learned, to another only 
those reactions which arc stereotyped. Probably an author is not 
certain just what he means himself; he may rest assured that his own 
meaning la acldom the one conveyed to the reader. 

The concept of "mstinct’' is so confusing that many authorities 
advocate abandonment ci the term m anything approaching a scientific 
di.sous3ion. Tina ambiguity is not so much a matter of the existence 
of mstmcls as it is a conflict ovoi the best way to explain them and 
which reactions should be labeled instinctive. Instincts, too, may be 
considered fiora either a neurological or behavioristic point of view. 
All wiilcrs stress Iheir inherited natine, but theie is little agieement 
as to Ihoir puiposivcness.* Some attempt to difforontiatc clearly 
between reflexes and instincts,’* while others state that any distinction 
is based upon n'liitive complexity and is made for convenience only ® 
Instmcls are classified in torins of neuial organization, behavior, the 
.situations alimulating thorn, the pmposes which they seive, oi the 
emotions accompanying them. Some writers list many,' others only 
a few " There is no conconaua of opinion aa to whether a certain 
icaclion fihoiild still bo called instinctive after it has been modified 
liy expel leucn, or whctluii it should bo tcrined learned.® In one 
context an instinct is a Bpocific reaction composed of a number of 
relloxos;’ m another it is a quite variable pattern cliaracteiized by its 
puiposivnness and progiess toward a preconceived or unconceived 
goal “ Some wiilors think of intelligence and instinct as being 
anlithotienl A typical quotation, though seldom appearing in so 
naive a foi'in, is; "The behavior of animals is regulated by instinct, 
that of imiii by lulclligeiicc, by icason " Opposing Lius view, Myers 
writes. “I conclude then, that instincts aio not, as has been generally 

' Yet McDougall wiitos ‘‘Outlines of Psychology ” P 71 But tho gicai 
inajoiity of nil imiUos would ngiec that we may piopeily call instinctive those 
ivnctions of ainniiils whiuli bcrin to be puiposivc 

* Kodka, Knit. "The Giowth of tlio Mind ” P. 90IT 
” Cnmcion, E II • Op. al , j) •\2 
‘ Thoiiidihc, Fi. Ij.. ‘‘I'Waoiitumivi Payohology " Vol I 
“ MallongaM, William • "OulhnoB of Psychology ” Chap. V. 

“Moigan, C Lloyd • "Animiil Beliavior ” P 71 

’ Watson, John 11 “Ilphnvioi ” P 100. An instinct is a scues of chained 
icllcxos, 

’ ICoflke, Kurt Op, ctl., Cliap. 3i , 
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supposed, identifiable with reflexes; nor are they, as otliois have 
urged, a terlmm quid beside reflexes and inlelliRenei'. AccoidinR to 
my view and my use of the word, instinct, regiiided from witbm 
becomes mtcUigcncc, intelligence legiuded fioin without becomes 
instinct To Mycis the diffoionce between inslinct and intelligence 
seems to depend upon tlio position of tlic observer. 

We ftie inalinclively kind, clcvei, stubborn, oi ciilical. All Unit 
we arc is the siiin of our inslincls and experiences, an educational 
platitude ficquently staled but as nieaningle.sH as the slalenient that 
the word "it” is nothing moic that "i ” plus “ t ” Thi' word "instinct'’ 
is used loosely and repioscnts no derimle idea. It may mean any one 
of a half dozen things, yet its use continues in our .scientilic (liscu''Hions 

Lastly, the wind "intclliRence,’’ though leiwlily and freely used 
in technical wntings may icpio.sent any one of the following concepts. 

1. Ability lo adapt oneself to novel siluntions ’ 

2. Capacity for knowlctlge plus knowledge i)o'<3e-.Hed ’ 

3. Inhibition, mmlysia, peiscrvcrauco * 

■1, Capacity to actiuire cnpncitics ‘ 

6 Copacifcy to Icnm or piofit by experience • 

0. Judgment^ 

7. The lunotioning of two factors, one general and opcjiUiag la all HitiialKUH, 
the Qtboi specific and opciatingni eneb paiticiilar HiUuvtioii,’ 

8, Absti act thinking.* 


> Myoia, C. S.‘ Bnlith Journal of Psychology, Vol IIT, 1(110, p 218. 

*Pintno), R , Jourml of Ediicaltonal Psychology, Vol. XII, 11)21, p 130 I 
have always thought of intelligence ns the nbilily of Hie iiKlivaliiul to ndiijil liiiii' 
self adequately to lelativoly now silnations in life. 

* nonmoii, V. A C. Op ci(,p 20lt, InteUigCttce uwelves two fm’Uivs, eupiu- 
ity for knowledge plus knowledge possessed. 

* Thurston, L. L Op «l., p, 201f Intelligonce .. coatiuus at least tliiee 
psychologically ditfereniiabic coinponcnls’ (1) Capacity to ledeliiu* an insliin.live 
adjustment (2) Gnpaoity to inhibit an insUiiClive adjusliiKSit (3) The 
volitional capacity to lealieo the niodificd instinctive bclmvioi into uvci t lii'liiivioi 

* Woodrow, Iloibcrt Op. cil , p. 208 

* Dearborn, W. F Op oil., p 211. 

»Bmot and Simon Annie Psyc/wlogtque, Vol XI, 1005, p MID Tlicie ih in 

intelligence, It seems to us, one fiindamcntnl oi'Kiia . . . this is jiidgmenl. 

*Speaiman, C.. 'The Natmo of Inlolligoiicc and Ibo Ihincipb's of I'ogiiilion ” 
P 4(T. 

*Tcrman, L. M.: Jourml of Mucalional Psychology, Vol. XII, 1*121, p 738 
An individual is intelligent in proportion as lio is nbto to cniry on nliHtiaet tliinkmg 
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This list could bo grofibly extended, Some definitions would 
include moial and personality traits as a part of intelligence; some 
would include the emotions; some would consider the word as being 
descriptive of bchnvioi, some as being a static component of the 
"mind 

The lack of concern ovci tins state of affairs is stiikingly illustrated 
by Dearborn, who begins bis shine of a symposium upon the nature of 
intelligence thus, "The commonly accepted definition of intelligence 
is . . Tho very senes of lu tides to which he was contributing 
brought into icliof the fact that tbero is no “commonly accepted" 
defmilioii of intelligence, nor is there much of an idea as to its nature 
Picssoy comes out with the slaitling confession that, although he 
spends most of his time measuring intelligence, he la not much mtereatecl 
in its natuio. 

This lack of agiccincnt over the nature of intelligence is more than 
one of dcfinUioJi. Hricliy considered there are two extreme points 
of view hold liy Thorndike and Spearman respectively, with other 
authoiities occupying tho ground in between. Thorndike believes 
that wo have us many mtclhgonces as wo face situations, while Spear- 
man bchcvcH that his G opoiatos in all reactions Quoting Thorndike' 
"A table of the known dogiccs. of iclationslups would abundantly 
confirm llie HtatoincnL tliat the mind must be regarded, not as a func- 
tional unit, 1101 even as a collection of a few goncriil faculties which 
work nroapccUve of puiUcular mivtoual, but rathci as a multitude of 
functions, ouch of which involves content as well as foim, and so is 
related closely to only a few of its follows, to tlio others with greatei 
and greater dcgrccH of icinotcncss 

Interpreting a similar table of iclationslups Spearman writes: 
"And thus tlicic emerges the concept of a hypothetical general and 
purely qualitative factor underlying all cognitive peifoimances of 
any kind . . . The factoi was taken, pending further information, to 
consist in something of tlic nature of an energy or powei which serves 


' Yot wo uin iicioss tlio followiiif; <i"otaliou Woiiioe, Walter S "Diieetmg 
Leauiiiig in tlio Iligli Reliool " I’ 302 Somo words that aie used with only n 
gciimil iiiciiniriK iii coiivcTsatiun and in non- tcoli meal fields, havo been assigned 
inccmo ineaiiiiigH in tlio field of ('duration Etninplcs of auch words are Staiulaids, 
intolligrneu, , , (‘to, 

’Drailioin, W l'\ Join iml oj Educattonal Psychology, op cit , p, 211 
» Tlionidikc, K L.. Educaltonal Psychology, Vol. Ill, p 3Q8 
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in common the ontii-c corlcx (or possibly even the whole neivoua 
system).’' 

All of the available space between 'I'houiihko luul Spearman is 
occupied by authorities Mveryono cun find a defmilioii of intelligence 
to suit his tompcrnmciit and capacities. As Hponririun has so well put 
it . “The reason 18 now evident why all hoiucli for the nieauing of intelli- 
gence has, even with the gicatcst of iiiodinn i).sychologi.sls, always 
ended m failure. It is simply that, in point of fact, this word in its 
ordinaiy present day usage, docs not possc.Hs any doflnite moaning.*’* 

The fault with educational writers i.s that loo many attempt to 
give a pedigiecd meaning to n mongrel woid ],ong ago tho chemist 
learned that if he wished to convey a icspccLalilo thought ho must 
use a respectable vehicle of cxpicsslon. IIo no longer speaks of table 
salt, but rather of sodium chloride. It is as imposbililo to c\tract 
piecise, scientific meanings fiom woidb on the longue of every novelist 
as it is to inject such meanings nUo words which ulicady ayiulioliiic 
any number of diiXeient concepts. 

If popular terms can’t bo isolated horn popular niranings now ones 
must be manufactured, and Icctiireis and novohbls will not make the 
change. 

’ Spoannan, C.' Op; cti., p 6. 

P 10. 



THE AUTOIMATTC PEEDICTION OF SCHOLASTIC 
SUCCESS BY USING THE MULTIPLE REGRESSION 
TECHNIQUE WITH ELECTRIC TABULATING 
AND ACCOUNTING MACHINES 

DAVID SBGBL 

Dopai tmoiit of UcHoarch, Long Boacli City Schools 

The proclietion of scholastic success jn general, and m the secondary 
school and college field in particular, is m need of devices foi shoi terung 
the laboi and tune necessary for calculating individual prediction 
scores. This i.s true rnninly because the prediction of scholastic 
success usually involves the use of the multiple regression equation. 
The work rcijuued to calculate scores after a multiple regression 
equation is obtained i.s almost prohibitive in a practical situation. 
It IS possible, ns Hull has shown,* to construct special machinery 
which will make picdictioiis according to regression equations that 
have boon worked out. However, the cost of constructing such 
macliiiieiy foi this Bpocinlized use piobably will prohibit its extended 
use foi some lime. In the mcaiiUmc it seems desirable to adapt the 
use of automatic calculating innchiucry more generally available 
to tho problem 

We fouiifl that the tabulator and key punch units manufactured by 
the Intcrnaiioual liusinoss ^[achlno Corpoialion undei tho Hollerith 
Patents were machines which would perform the opei ations indicated 
by the multiple legiession equations when such equations were 
adapted in certain ways 

We will de.sci'ibo the use of these machines by desciibing their 
use in a particular instance. 

We wished to make success piedioUons m tho junior college field 
in each of the following subject gioups Physical science and mathe- 
matics, English, social studies, languages, and biological science, 
on the basis of the numbei of A’s and B’s earned in high school, the 
scoies in the Thui stone Psychological Examination, Edition of 1929, 
and the scoies on the vniious paita of the Iowa Content Examination, 
all rocoided at the begiiming of the junioi college course. 

Tho con elation of any one of these items with oollege success is 
usually loo low to he used with much efficioncy in prediction (excep- 
tions to this general statement arc shown by our own data for physics 

'Hull, C L.: “AptiUHlc}TcBtinB,’'p 487 

130 
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and mathematics), and thcieforo a coinbinnlum of semes or ratings 
into a composite rating is dcsiuible. AVilli a viiiioty of correlations 
of the sepaiate items with success m a college subject present, it is 
desirable to weight the items difrciciitly from tlio natiual weighting. 
The method whieli gives this liest weighting is the mulliiile legre.sHion 
equation technique. 

For the purpose of this de.sciipt.ion we .sliiill iunil. oni. selves to 
the prediction of the first two of our college subject gioiips. 'I’lic 
ontmion of aviccosa in the snUjeot gvovqw iH tUa miwk. UM\Ue, iw the 
subject groups the first sciiiesler in junim college 'J'he coi relations 
between the items nud the two college subject groups aie given in 
Table I The inlercoirelalionB between the tests me given in Table II 


Tahi.b I— ConnEi.vTioN8 nurwBEN Piiudiction Itkmk and Ckituiua 
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Upon the basis of these coriclntion.s the |3 ’h for tlie muUiiile regicn- 
sion equations were obtained. 

In order to use thelloUcrilh oaril winch is ui-ed in tlii'sc mucluiu's 
It was necessary to reduce all scores to a basis of 0 to 9 inclii.sivi', 
corresponding to the mimbcrs on the llollonlh caul. T'iiis was (lone 
by reducing all dis^ibutioii of scores to a basis of 0 to 9 according 
to the schedule of Table III. 
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Tahle III — SoiiEDULTi OP Trams^vioted Scores 
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Sigma 

Ti anHinii ted seorc 

Sigma 

Tiansmuted scoic 

— CO to ^2 0 

0 

0 to C 

5 

-2 Oto -1 f> 

1 

5 to 1 0 

0 

-1 6 t« -1 0 

2 

1 0 to 1 5 

7 

-1 Oto - f) 
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4 

2 0 to 00 
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The mxiKiplo logiohsion equation xvhicli is in general 


Xq = - -/3oi 23 

O' i 


where 
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will bo simplified because all sigmas arc equal since all distiibuUons 
have been reduced to a sigma liasis, The equation becomes a 

Xq ~ / 3 oi 23 - nXi + 002 131 . 71-^2 + 0On 123 « <n_l>Xn 


C disnppeaia because 

ilfo ^ /3 oi.23 < . fiXi — )3o 2 131 * " ^Oii 121 * (fi-l)X‘n = 0 

The i3’s resulting will be in the form of a decimal fraction. We have 
arbiliarily changed thoRC fractions to whole numbers ranging from 0 
to 3 inclusive in order to fit out tabulating equipment The equation 
for physical science and maihomatics is as follows, 

^0 = OXi 3X2 4 " 3 Xs + X4 + Xs + OXfl 
where the symbols have the following meaning in tianamiiled scoie 

Xi = Number of A*s + B^s made m high school 
X 2 = Tliurslone test score 

AT = English test score of Iowa High School Content Examination 
X 4 = Mathematics test score of the Iowa High School Content 
Examination 

Xfi - Science lest score of the Iowa High School Content Examina- 
tion 

Xo = Social studios test score of the Iowa High School Content 
iCxamination 


'Kelloy, T L '^Statisticul Motliocl,” p 2S3, fomuila 213 
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The equation is reduced to 

Xq = 3 X 2 + 3A’a -jr Xi + Ao 
since OA"! and 0A''« drop out. 

Because of changing fractions to whole numborH and restricting the 
weighting to 0 to 3 inclusive, the iniiltiple corudalion cnpfliciont is 
reduced somewhat. The multiple coirelation coefTicieiiL of the above 
equation for mathematics and science is .80 Before the reduction 
and restriction above inenlloiicd, it was tSl 
The equation foi the prediction of Englisli was 

X„ = 3X, + 2A'» + Xi. 

The multiple coirelation coelRcient for this equation Is .02 Before 
the reduction and reatiiction was made, it was O."). 

The method of using these equations with the tiiliiilatov and 
key punch is as follows: 

A Hollerith caicl ib punched for each sliidenL The emd used 
IS one divided into sections of thico colunma each. In eacli .section 
the transmuted score of tlio lest is piiiicliod in every column. A sample 
of the card is given hero for a student who made a hcoio of four in 
high school marks, a score of five, m the ThurKtono test, a score of six 
in the English pnit of the Iowa lost, a score of five in the inntheiiuilics 
part of the Iowa test, a score of four in the science part of the Iowa test 
and a score of seven In the social studies part of the Iowa lest 

Cards so punched nio put into the tabulator and the wiring adjusted 
to fit the equation For physical science and mathemalics the wiies 
will be connected as follows* Tlirec to Iho Thunslonc score section 
( 3 X 2 ), three to the English part of the Iowa test (IIA'^), and one each 
to the mathematics pait of the Iowa lest (A^) and the science pait 
of the Iowa test (Xs). AVith this wiring the caub can bo 1 un tluough 
the tabulator and the weighted scoics for each student will be added 
up and the sum printed together with the mimbei of the student 
In case the tabulator is not a printer or one which atlds up the dilTeHuiL 
fields, the numbers can be added up mentally and the lesull together 
with the student’s number wiiltcii down, 'riio eonipoHile scoie 
so obtained may be used diicclly or transmuted into llie hcliobirship 
scale used in the institution. Where the miiUiplo corielatiou eoelli- 
cient IS not very high the regressive effect of the equation should be 
accounted for in any transmutation, that is, the origmai .spriMid of the 
scores must be restricted to fit the effect of the regression equation 
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In case the multiple conclation cociricicnt i8 Ingh the logrosHivo 
effect being email can be dwegartlcd In this way Ihc ciiids can bo 
run through the tabulator ogam and again until a picdictioii is obluincd 
for each subject. 

The method described sliould lie of valiu' not only wheie largo 
numbers of predictions aie dcfeirablo foi use in individual guidance but 
also for purposes of liomogoneoiiH clnssliicatioii upon tbo basis of seveial 
different items. With the data pimchoil on the cards at convenient 
times duiing the semester, the cards can bo run Ihroiigli and a new 
homogeneous classification dotonninod for vaiious siibjecls within a 
comparatively short length of lime. 



A TECHNIQUE FOll EXPERIMENTATION ON 
GUESSING IN OBJECTIVE TESTS 

LOUIS GIUNICII 
OoUcgp of Uic Cily of Now Yoik 

At a lime wlicn the podagogicel status of the true-false test still 
'Liangs m the baUince/^^ there would seem to be a considerable field 
for a technique poculuuly adapted to experimentation on the element 
of guesBing Tlie wiitcr'a ^^iiulex of guessing^' is obtained by scatter- 
ing, among the gcninno quesUons of a tnie-falso or multiple choice 
examination, a number of questions which involve very obscure facts, 
or newly coined names. As applied here, to a group of college jumois 
and aciiiora, it gave consideiable evidence of its validity; iL was success- 
fully employed to loduco gu egging, proving more effective than the 
usual instructions against guessing; and it was suggestive of a new 
analysis of responses to true-false questions, 


PllOCEDURE 

A fifty item Lruc-fivlso lest on gcncial psychology, containing at 
iricgular intcivals ten index questions, was administered to a lecture 
class 111 sooial psychology. Attached to each sheet was a pre-test of 
twenty items of the recall, or complotiou type, based as nearly as pos- 
sible on iliG same topics as the true-false test, 

Tlic instiuctions pieccding tlio true-false lest differed for half of 
the papers, Tiic control group (Gioup A) received Iho following 
full instructions against guessing: 


IluAD TiinsB Instructions 

Put a circle aioimd Right oi Wiong You sre not expected to iccogiuze all 
of these statements Do not pwess, becauso of tlic usual scoring system 

The remaining half of the class (Gioiip B) found these new chiee- 
tions on tlicir ^sheets: 


' llucli, G M ’ “Tlio ObjGclivo or !Ncw-lypc Examination ** Hcott, Poiob-man 
and Compfvuy, 1920, p ^95 vSeo pp 318-3G8 foi an tixccUout digest of expeu- 
in on tat ion on the siihjerfc discussed hoio. Note that piobably tlio best piactico 
in true-false testing involvea instriictions agiunsfc guessing, finil scoiing which 
corrects for guessing cuoifl 
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Head TiibsB In stkuc cions 

Put a puclo arotiiid Right ov WiouK- You aio not ovpec led lo locogniM all 
of these slftteinents Do mi guess, beenuse of the iiHunl seoiiiiR syfllnni- 

Suppose you met this question R W The Funk Olmits iiiensuie tlio iliHcumiti.N 
lion of emotions. Thcro mo no Funk Clmits, luicl if time wero you could not 
have hoaul of them To answer this qiieHltoa would indiento Riie'.siiiK on yoiii 
part Tlioio mo ft good miiiibor o( qUestioiiH of Dim type and ot Hmiilnr types 
ecalteied thiaugh tins test Each one will mdiente Rne«sinK if iitiiweied 
Tlicieforc answoi only what you know, 

To obtain ii random halving, Iho sola woie uiningod altoinately 
according lo the Iwo types of cUicetions and woie deiilt out thus 
Each student received a complete lest set as he cnlcied All direclioiis 
supposed nccessaiy were punted on ihc sliects, and no (jne-stions weie 
permitted across the room, /or obvious rea.son8. 

The gioups wcio, then, rnndotn halves of a liigliiy .selected group, 
each half numbering tlmty-four They weio expected to diffei on the 
true-false test because of the new inslructioiis. The pre-test was 
considered advisable, m order to confirm the siimlmily of tlie two 
groups as to distribution and total auioiinl of infoimalioii. 

The method used here for cstabliHhmg a control was preferred as 
one which resembled the pioccdure of an ordiiiaiy cliis.srooin lest, iiiul 
did not smack of cxpenmeiitalioii lo the sLudciU.H. Eveiy e0o;'L was 
made to give the test under cliissioom conditions. Several other 
oonsideiations porlaining to later iiiLorprotations idso caused the test 
to be giv<?n m the form described. 

The scoics of the two gioups on the prc-lcst ranged fioni six to 
twenty. With a maximum possible score of twenty, the means wei e 
12 56 with a PE of 2,1 for B and 12 23 with a P]'l of 1.9 for A The 
groups appear similar enough to render sigiiificaiit any conhidciablc 
differences which might be found on the true-false tests, It should be 
noted that foi most of the mean amounts given below the deviations 
weie large, and where differences occmi’cd, ovoihippiiig between both 
groups was consideiable. 

Time was not called unlil it appealed Lliat piaclicnlly eveiy 
student had finished. The stiulonl.s wore then asked to indiCtili; Ihc 
questions on which they had guessed. PiecauLions weie liiken to 
seciiio complete cooperation. The studeuts were luUUesswl mfoi- 
nially by the wiiter, who is not thoir instructor,' and were told tliat the 

'I am indebted to Dr Maximilian II Selineck of Um ('oI1(<ko of Die (Juy of 
Now Yoik tot pcvmrjsion to admunatcr this examination 
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test in no way concerned themsolvos, that its purpose was purely 
expciimcntal. They weic asked to tear off or delete their names, or 
any other ulcntificatvonB, from their papers. The point was repeated 
to them that in spite of their directions they certainly had guessed on 
some queslions, piobably on a large number. They weic asked to 
cooperate m an “mtcrcstmg experiment” and to indicate by a capital 
G all gucHHOcl answers. Papers wore then collected. 

The writer latei had the opportunity to receive objections from the 
class against tlio pioccduie of the experiment A number of students ' 
questioned the ability of the class to indicate its own guessing No 
opinion was met that lack of compichonsion, suspicion, or resentment 
had affected the frankness of the class. 


{:>UMMA.UY OP Results 

Evidence of the cooperation of the class is found in Table I. It 
will bo beon that in Choup A, scvcnty-lwo pei eont of those questions 
called " guessed” wore actually correct, while in Group B, seventy-five 
per cent were correct. It may be safely assumed that the class tended 
to be unresolved in indicating guessing; which was the effect desired 
And yet botli groups indicated ns guessed only half of the index ques- 
tions which they answciod. Tlie explanation of this apparent paradox 


TabI/B I. — Mb\n ScoHiis OF Gnour A (ContiioIv) and Group B (New 

Directions)^ 



Group A (34) 

1 Gioiip B (34) 

Pre-test scores 

12 23 (PE 1 9) 

12 66 (2 1) 

Index questions nnswou»d 

4 2 (PE 1.7)^ 

10 (12) 

Index qiicstiona iinliontod ns guessed 

2 1 

1 0 

Actual questions light 

27 2 

25 1 

Actual questions wiong 

6 3 

6 1 

Actual questioiiH omittod 

0 6 

9 8 

Actual quGsUous ludiGated as g\U’^«cd luid correct 
Actual qiicstioiiK indicated as guessed and incoi- 

3 8 

3 3 

loct 

1 6 

1 1 


‘ Noto Lho HiKP of iho PK'h of tlip iiulox d is ti Unit ion a foi both gioups Tito 
dilYoronco botwoon tUo jiro-lost inoRUft bniivs n ratio to its P E of about 76, makiog 
It of eigiuriciinci* As foi Iho nidox incuriH, tlio latio of the chlTciciicc to it^ P E 
m about 0 C, easily donioimtiatiug statistical aigmncance j 
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will appear later It is evident, however, that the stiuicnt'a intiospcc- 
tion makes a poor index of guessing. 

With reference to the decrease in guessing, it will he seen from 
Table I that omissions were merensed forty-nine per cent. The num- 
ber wrong was decreased nineteen per cent, the iiuinbm light eight 
per cent and the number indicated ns gucs.scd seventeen per cent. 
Comparison of this last figure with Uic othcis show.s that Oroup B 
was readier to admit gucs-sing tlian was Group A. It bIkhi id he s(.i essed 
that all results heic oblaincd aie based on a single test and on a highly 
selected group; so that the icliability of these diffcicnccs is iiui, linally 
established for all groups. To judge by the mean number of index 
questions answered, guessing was reduced about onc-hiilf. However, 
it may be argued that since Group B was put on guard against these 
questions, the results on the index may not bo valid as a measuie of 
guessing — that the reduction was caused by the ii'eognUum of the 
index questions as such, and did not iiulicuto a i eduction m gue.‘>sing 
on the body of the test. Thieo evidences arc ofloicd in answer; 

1 Argumentative evidence which will be picsoiUcd below in Ihc 
analysis of student responses. 

2, Each group marked as gucased almost a pri’ciso half of Iho 
index questions answered. As a matter of fact, it will up])ear from 
Table I that Group B, as compared with Group A, londecl to ovor- 
estimate the number of its guessed answcis. This has been pointed 
out above Group B was thcrefoic less awnre of gue^i.siiig on LliOhO 
index questions which it answered than was Group A; .sinco if they wcio 
equally aware of gueasing, and readier to indicate it aftoi the Icsl, 
they should have indicated a greater proportion ns gueased limn did 
Group A. When Group B, theicforc, guessed on an index question, 
it was at least in part due to the fact that they wcic relatively unaware 
of guessing. The relative tendency against guessing dirtied over 
from the body of tho test, and explains wholly or m part the reducUon 
in the average index score 

3. Fairly conclusive evidence is furnished by these figuios: For 
Groups A and B, the ten highest and tho ten lowest pie-tcst Hcorc.s 
wore selected, and their index scores compared, as shown in Table 
II. Tho pre-test scores were used as the civtcrion of iicliifivomont, 
since the true-false scores were subject lo vaiying factors and were 
therefore unsatisfactory. It will bo scon that the heat and Llio poorest 
students scored about the same on the index. Poi Groups A and B 
the ten papers weie then selected which had Uic highest nnd lowest 
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number of index questions answcicd, nnd thoir pie-tost scores were 
comp^ired, as shown in Table III It wdl be seen that the students 
who guessed most and least on the index weie equal m ability. These 
figures indicate roughly that no significant relationship exists between 
knowledge of the material which has been studied and ability to 
discein the index questions. An additional conclusion which la bound 
up with Iluft latter would have to be, that the better students do not 
differ from the pooler in llicii tendency to guess, or rather to attempt 
questions which are new for them. Such questions of course consti- 
tute less of sheer guessing foi the superior pupils, Furthermore, the 
absolute number of such questions is greater for the pooler pupils. 


Tadlu II — Mcan Hcoima or Forty Studemts Sheectbd Acoohding to 

Acihuvbmbmt 



Gioup A 

Gioup B 


lliglicat 


Highest 

Lowest 


ten 


ton 

, ten 

?ro-toab 

15 5 

9 2 

16 

S 3 

Guessed (iiulox) 

4 5 

4 5 

1 6 1 

1 7 

Guessed and indicated as guessed 

2 0 

2 3 

1 1 

0 


Table III — Mean H cores or Forty Students Smlected Accoiu>ing to Index 

iScoums 



Gioup A 

Group B 

1 

Highest 1 
ten 

TiOWOst 1 
ten 

Highest 

ten 

1 

Lowest 

ten 

Index seoio 

7 5 

1 7 

1 

4 1 

3 

Index questions indicated as guessed 

3 fi 

L 2 

2 4 ! 

3 

Pi etas t 

, 12 4 

1 

12 0 

12 4 

12 4 


The valichty of the index, then, \s appaienUy not affected by 
awaroncHS on the pait of tlic student oi by hia knowledge of the 
subject covered. The index docs not howevei puipoit to be an 
absolute measure of guessing, since it coniniiia a certain amount of 
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recognizable material^ Djffeienb inclcv bcorca will rosull from 
difierent sets of index questions. But if Iho items arc eqiialcil as to 
their indicatwe values, they form a basis for piecisc compansonH, and 
for correlative work. They are obviously as opphcablc to the multiple- 
choice test as to the true-false. 

Thu Inddx (iuusTiONS 

The ten index questions are given here m tlio order in wlncli tliey 
appeared on the test, foIloAVed by figures representing the responses 
elicited by them of light oi wrong, and also the number of times they 
•were indicated as guessed. 

It will bo seen that the guessing element in lliesc questions vttiics 
from an almost absurd amount in hevernl, to so Bmall an amount in 
otheis as to rcndei them almost conventional. A bettor index would 
be composed of equated items. It is not sheer gucbsing tJiat is 
measured by most of those heic, but the tendency lo attack material 
that IS new, and offers no Icgilimalc basis for an aiiRWcr. 

^ Nor doe^ it measuic thoso quesUona winch am anawerod with an oven ohanco 
oi success If it did, the foMoiving formula could ho applied: 


wliere G^ia the number of questions guessed, I the nunibor of qiiostioiiH conn>osiiig 
the index, N the mi mb or of theso questions answered, and 0 LIkj ii umber of omn- 
sioiia on the body of the tost Half of 0 would icpiescnt the inimhci nglit oi the 
numbei wiong thiough guessing If the foimiila bo applied lo om <lala nliove, a 
striking similarity is found botwcon both gtoups, ui Uieu estimated “ seoies 
The miitiber right or wrong through gucaaing is 2 4 foi Group A aud 1 2 for (koup 
B Subtvactuig these amoimta fiom the number right to flud tim luui aem e, w e 
obtain 24,8 for A and 23.9 fo\ B, Subfcraetmg fiom tho mimboi wiong to fuul tho 
actual amount wiong for othoi reasons than guessing, we obtain for botii halves 
an identical remaindoi of 3 9. This is what wo Bliould expect for such snnilai 
gioups furthermore, the labio of their G*s is about equal lo the ratio of then 
index scores The explanation of theso agreement'?, however, presents many ddh- 
cultiea They are probably spurious, unless by accident tlio index flam pi ad gn end- 
ing oonectly. The possibility of using tho index ns a rofmement in scoiing, oven 
for groups as a whole, lequiics further doinoii.sti ation 

It may bo argued that tlio index questions, if equated, coiiluui a constant 
proportion of guessing, and can bo converted to piuo guessing scoiea by multi- 
plication As will appear later, however, what wo oncoiuitcr on tho test ih nut 
pure guessing, but guessing diapeiscd aa an element among many questions, anil 
subject to uncei tain rulca of probability. 
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The questions aio composed cithci- of obscure facts or of proposi- 
tions involving a newly coined tcim, and should be conventional m 
strucliiio Tlie practical application of tlie index and of the new 
instructions, leniaiiis to bo furlhor dGiUonstrated. It may bo that 
the piosent sLanclaid instructions (Do not guess unless you have some 
basis for an answer) will offer the best icsults, and that guessing need 
not bo fuithcr i educed. It may be that R-W scoring is more valid 
for the very reason that it lake.s into account the wrong answers. 
It will prove too difileult to construct tests with reliable individual 
indicesj and too cumbersome to score such tests, to allow of their 
widespread use The u.sc of meaningless material may prove objec- 
tionable in clnssiooin practice since it renders possible ictention of 
matter whicii is undcsiiable. It may also be said that the new instruc- 
tions are thioalcmng and punitive in attitude. But they aic no more 
so cssentiidly than instructions which warn of R-W scoring; m fact 
they offer moie icasonalilo justification to the student for penalizing. 
Whatever pedagogical faults may appear against the technique, theie 
lomain many possibilities for its use m objective tests outside of the 


TADiii] IV — SnowiKU Tim ISrpBCTivnNnsb of tub Vaiuous Index Questions 



Marked 

light 

Marlccd 

wioug 

Indicated 
as guessed 

1 Convci'gonce of facloj'fl will piohiibly explain 
the tiansfoi of tiainmp; , 

If 

12 

9 

2 Tho Jiiko’a Jiifitoiy hIiowh that fomteeii per 
cent did not become public cliaiges 

22 

10 

14 

3 TliG acciiiiaitivo maliuct is today considered 
coiulnctivo iia well as tlyiminie 

10 

s 

8 

1 One cause of illusions is tlic functioning of dif- 
Juspd nB'50cmtion-arc3 

23 

1 

12 

5 , There n\c i\cvci moio than three thnlanuc 
mcmbiaiios 

4 

4 

! 7 

0 Glanclulai ini&funoiioiung is the cause of pit- 

UIIOSIS , 

9 

U 

6 

7 Divulmg a learn nig cinvo into /oiica inci eases 
leliability luit lowois validity 

10 

10 

11 

8 TliGro aiG moio HCiisiiizod pigiiioiit spota in llic 
biaiu limn iii tbe Hpjnii.1 coul 

17 

7 

iO 

0 Lnscllos found tlin wliiLo and colored inces 
about Ofiual in keen ness of poiceptioii 

17 

11 

18 

10, to vftCuto tUe 

CMstonco of tho negative peisonality 

0 

9 

9 



152 The Journal 0 / Educahoml Pnychologu 

classroom. It will be noted Unit the pobsibilily of detection consti- 
tutes adequate motivation foi reducing guessing 

The distribution of index scores (Table V) shows that extreme 
amounts of guessing are almost entirely eliminated, while there is a 
much gicater fiequcncy of very small iiinouni.s 

The writer found these qvicstions easier to inopuro tluin tho.se wiucli 
were leal. Care must bo taken only that obscure fads bo obscuie 
enough, and that an answer of False should not by some chance be an 
honest and correct answer to a sentciico involving a noologisin, us for 
example, in “The aoephclon is located in front of the thalamus " 

The greatest utility of the technique ho.s in furlhoi tlieorcLical 
investigation Among the possibihUcs arc; (1) Coirelalivc work and 
the dotcnnuiation of 1 elutions between guessing and the diffoicut 
elements of a test situation. (2) Compaiison of the amount of guessing 
going into different types of tests, including even completion tC8t.s, 
also, estimation of the rektive amount of guessing going into specific 
tests. (3) A study of the distribution of student-types ns regards 
guessing. (4) Analysis of characteristics of questions winch invite 
guessing. (5) Study of the extent to which studouts arc luvaio of 
their guessing (6) Eotentlon of content with different tests (7) A 
measuie of one phase of classroom discipline, and of tlic eITGcliveiu'.ss of 
different instructions, motivations, poi'souahtics, etc (8) Kxpori- 
mentatiou leading to the perfection of the index, confirtniug its validity, 
and determining its possible application to the classiooin The pos- 
Bibility of employing it as a veftnement in scoring m of greatest impor- 
tance here, 

The ddomma appealing from oiu results is this: While only luilf of 
those index questions answered are indicated as gues.sofl, thice-quailei.s 
of those so indicated on the test proper arc coucct It is of coviise 
assumed that the effect of “.qpecifio dctei miners” alone will not explain 
this The analysis which will presently be given is .suggested in 
explanation of this phenomenon, It does not, of couise, derive any 
definite corroboration from our figures, but is incicly siiggo.slcd by 
them. 


TAnr.n V — Distiudotion or li’iinquuNoiiis or Guiissino 


Index score | 

0 j 

1 

2 j 

1 ^ 

4 1 

6 j 

0 

' 7 

1 

H 

\) 

U) 

Fiequetiey, Group A 

1 1 

3 i 

6 1 

6 1 

10 1 

2 

0 

x 

2 

O 

1 

Prequeney^ Group B 1 

8 

10 ' 

a 

fl 1 

1 

2 

! 

0 1 

0 

0 

1 

{) 
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Guemng in Ohjecitve Tests 

Tub Natxjiiid of llissroNBES 

Discussion to date lias assumed that the response to any question 
IS determined by one of sevcinl factors; either information, guessing, 
mismfoimation, oi a “hunch'' icsulting from the characteristics of the 
question (Wiedemann’s specific deleiminers). It has been recognized 
that guessing varies at different times, with different gioups, under 
different test conditions, and also with each individual examinee It 
has boon found that guessed answers are more often correct than incor- 
rect;^ and tins fact has been explained ou the basis of subliminal con- 
figuiations of knowledge. There is also evidence that R-W scoiing 
ovei -penalizes students and it has been pointed out, in partial explana- 
tion of this fact, that answers wrong through misinformation are 
penalized doubly It is obvious that this routine analysis will not 
suffice to explain our results in this study, A closer analysis of the 
factois dotoi mining a response vs therefore relevant, 

Questions arc factual insofar as they measure the recognition of 
terms or of facts. Questions arc ddiberativej involving ;}udgnienif to 
the extent that they icquuc the recall of facts to decide the truth of a 
slatomcrit not already taught A question intended as factual may 
sometimes be attacked in delibciative fashion, to substitute for or to 
supplement iccognition. “Deliberation" involves recall, comparison, 
criticism, ingenuity, application, practice in pioblem attack, and any 
number of phases of gencinl intelligence It may be an acceptable 
compensation for inability to iccognize, if by ifcs means the correct 
answer is arrived at, from true picmises and by a coirect process of 
reasoning. 

The answci to any question is the result of a number of factors, not 
of one. Thus in the (rather pooi) question, Wundt established ike 
first psychological laboialoiy in 1870^ a student may recognize the 
name Wtindt (infoimation) but be uncertain as to whether this man 
was the pioncei in question (guess). He has an idea that Titchener 
was the founder (misinfoimalioii) He docs not lecognize 1879, but 
decides its probable accuracy by checking it with other dates (delibera- 
tion, as well ns guess) The piobablo accuiacy of the date, and other 
considoratioiis, now lead him to believe the entire statement true 
(hunch, or suggestibility). He answers in spile of his uncertainty 
(menial set as to guessing fioiu directions). 

* West, P. V A Ciitical Study of tlio Right Mmus Wrong Method Journal 
of Edncaliojial RehCaichf Voi, VIII, 1929, pp l—Q 

^Rueh, G. M Op. cit,, p, 362 
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We should then regard guessing as tifador insofni us it (jiiosliou is 
anawored with uncertainty, wlulc inisinforiniiliou hccoincs an made* 
qiiato term. There may be miHinfoi mation, it is lino, ns to a jmu t of a 
question; pioblematic or paitly problematic questions unsweicd with 
certainty but mcouectly nro faiily ficqucnt. Jlut practically all 
instanccB of misinformation, as defined hitherto, arc nccoinpamed more 
or less by uncertainty It la difiiciilt to asauine (,hnt students learn 
complex facts in a form precisely mcoircot. 

If the final score formula for tho number right can not bo oxpicsscd 
m terms of whole questions, does it tend to be t!ic sum total of the 
fiachons of information plus one-half the total oi fiaclions of guessing- 
factors, plus approximately ono-half of tho fradions of suggosLibility 
factors? Oi does the final score depend on the proportions in which 
these factois are combined? Docs each sontonce bear ils own rules 
of probability? (Note that the lecognition of a single lerin in a atafp- 
ment may furnish a due to the con act answer, for exainplo, by pliinnm" 
tion.) Do intelligence, training in problems, and application on tor 
also as factors compensating, legitimately or not, for lack of knowledge? 
Is much recognizable material necessary to assure a student that he is 
not guessing? Above all, what rules of probability govern questions 
made up of different recognizable, uniccoguizablc, and problematic 
proportions?^ Would these lules explain the over-penalization of 
E.-W scoring? Ifurther study might well lie directed along those 
lines. ^ 

It need not be pointed out that many questions, especially shorter 
ones, aio entirely recognizable or unrecognizable. It is also true that 
there are degrees of learning; that some facts aio on the borderline of 
memory. This situation introduces other factors which affect scoios. 
application, amount of time, and accident in striking upon oflective 
associations Those last few items will bo recognized as univeisal 
causes of unreliability, together with such elements ns copying, ambi- 
guity of the questions, attitude of student, conditions of the lest, 
obscure wording, etc. In pioblomntic questions an analogue to guess- 
ing is found in the process of hitting upon a line of ronsoning which 
lends to a correct answer, although tho background of information is 
very limited, and the judgment poor. 

‘Wood found lolntionahips between tho probicmatio quality of qiiCHluma and 
tbclr reliability, as well aa ono aspect of their validity. 

Wood, Ben D. Studies of Achiovoment Tests. Jowml of Bducalionol 
Psychology, Vol XVIII, 1020, pp 10 and 13. 
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Al any rate, wc cannot icgxu'd some one factor as the single cause 
of a given Kvsponse, nor can wc consider such responses at all analogous 
to coin-Ilipping, An exception may peihaps be made for siinplo, 
short, factual questions 

Wo may now bo able to ovplain the peculiarities of true-false tests 
which have alicttdy been menUoned We know, for example, that 
enough uncertainty may outer into a icsponso for the student to call it 
guessing And yet such questions may contain enough recognizable 
material to be answered correctly m more than half the cases. We 
may now i eject the dubious concept of misinformation accompanied 
by ccitainty. Wc may also explain why answers winch are changed 
by the student aie coircctly changed most of the time.^ We may 
deduce from our theory such veiy plausible propositions as these: A 
multiple choice of four answets may really offer only two actual alter- 
natives, since two olheis may be conspicuously absurd Oi, if one 
of the answers is known to ho incorrect, the chance of guessing cor- 
rectly will bo one out of three. If, on the other hand, none of the 
altci natives are recogiiizod, but one of them offers a "catch," then 
the chances of couccUioss aic less than one out of foui 

It IS obvioim that if a student docs not recognize a fact, he can not 
lomembci whether that fact was ever discussed in class, and can not 
decide whothor ho is c.\pcetod to know it Unless the question is 
altogether absuid or unconventional in appeaiance, he can not be 
suio whether it is an index item, or one which ho should know It is 
for this icason that knowledge of the picsenee of the index does not 
affect its validity This analytical evidence the writer has already 
piomisod to piosont. The effectiveness of the new duections is due 
to the samo situation To guess on an item unrecognized in part is 
risking an increase m index score 

SUMMAHY 

1. The index offeis a valid measure, although not necessarily 
absolute, of guessing on objective tests. Guessing is iieie defined 
as the toiidcnoy to answci questions which aie unrecognized either 
wholly or in part, when an answer can not be deduced with certainly 
from such information as the student possesses 

‘Mathews, O. O ISrioncniis Flist Iinpicssioiis on Objective Tests Also, 
Lowe, M L and Ciawfoul, C O Fust Impression vs Second Thought in Tme- 
fftlso Tests. Journal of IMucahoiial Psychology, Vol XX, 1029, p 106 and p. 286 
leapeetivcly 
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2 Warning as to the prcspncc of index qiioslions m tho test used 
here proved to be more effective in reducing guosBing tlinn the usual 
full instructions and warning of peiinlization. 

3, For a munber of reasons already explained, students can not 
reliably milicatc their own guessed answers. This fact is demon' 
strated by comparison of index scoic-s with our other numerical results, 

4. In this study, superior sludonts did not differ fioin pooier 
students in their tendency to guess; that is, in their average index 
scores It follows that they wcic no bettor able to diacern index 
items even when aware of their presence Tho students who giiosbcd 
most and those who guessed least, according to llicii index scores, 
were nevertheless equal in achievement according to a pio-test. 

5 Some of the results of this study were (hiUculb of explanation 
m terms of the conventional analysivS of student rp.sponscH to true- 
false questions. A revised analysis is presented, in terms of which a 
plausible explanation can be found for many of tho pccuhnritics of 
true-false tests, besides those appearing in this study. 

6. Argumentative evidence, based on this analysis, is produced 
to show that responses aie more often the result of several psyclio- 
logical factors than of one. Simple factual question, s lu o an oxcoption 
to this rule, 

7. Furthermoio, such answcis are not subjeot to simple iiiathomati- 
cal rules of probability in scoring; their piobnbilitics of coiTOctncss 
vary according to the different proportions of guessing, information, 
etc , that enter into the responses. 

8. Further studies employing the index tccliiiiquo aic suggested 
above, and studies leading to the orilicisin and improvoinoiit of the 
index will be of value. 
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The Science of Psycholog]/, An Inlroductory Study, by Raymond 
Holder Wheeler. New Yoik. Thomas Y Ciowell Co, 1929. 
Pp. XI + 660. 

In "Tlie Science of Psychology” Professor Wheeler of the University 
of Kansas makes n inonecring attempt to present general psychology 
m textbook foini from the Gestalt point of view In spite of; the 
difficulty of the task, the icHiilt is neitliei one-sided nor incoherent 
Nor IS It (pcrhap.s more surprisingly) unduly abstruse oi difficult. In 
parts the discmsHion involves coilam inherent difficulties, but the 
style is simple and the piosenlntion logical and clear. 

Wheieas most textbook wi iters sccin to base then eclecticism upon 
the pimciplo that IhoBc OKplanations which are most widely accepted 
at the time of writing arc to be prcfericd, Wheeler seems to base his 
upon the pYmoiplo that those explanations winch appeal to Innv simplest 
and most inclusive, luo to be piefcried. It would be more accurate 
to say that in both Wlicoloi'a book and in the usual textbook there is a 
mixture of tlic.so two principles, but that in the latter there is more 
evidence of the principle of gcncial acceptance than of the principle of 
"parsimony,” wheieas iii Wheeler’s book the reveise is the case. 

All living activity is described by Wheelci as goal activity, governed 
by the "Law of Confi gin aliens” and the "Law of Least Action ” A 
goal he desciibes ns 

tlio tormination or end of a given icsponsc, liowovoi siniplo or complex 
Tlcprcaonted liv those Htiiniili or objects in ii stimiiius-pattcru, the icftohing of 
winch rehoves tension in the oignnmin. UepicsontccI m the orgnin&m by n lolntivo 
eftuihbiiiini m the noiiiomucciilni ftyntem In bunging behn-vioi into relation 
with dynamical pi inoiiilcs, the goal is intoipioled ns a point in an eneigy Bystem 
towaid wblcli a body moves iiiidpi stioss, it is the point of low sticss of the systoin, 
and tho orgaiusin is logiudcd us part of the svstem ni which it moves The 
situation IB akin to a, giavilatioii Hy/itcin with its center constantly moving, along 
with shifts in tlio nligninotit of potPiitials elsowlicie m the system, 

W 
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"Whceler’a description of tlic "Goal" concept is moic definite and 
concrete than McDougall’s desci'iplion of llic concept of purpoHO and 
leas restricted in scope than tiie concept of desuea proposed }iy the 
psychoanalysts Although he employs it ns an o\planatoiy principle 
quite as imiycisally as these other iisychologists, he docs not give the 
impiession of chsLorlmg the facts to prove Ins point of view. On the 
central y, the largo iimouiit of experimental data whicli ln' brings 
together in the 556 pages of his book is clarified and unified by con- 
sistent examination from his defined viewpoint. 

Wheeler progi esses systematically fioin the sociological aspects of 
psychology to the biological aspects, with the chief emphasis, where it 
belongs, midway between these two cxlroinea, ou “Kmotivo Rohiivior'* 
and "Learning Behavior," the trcalinont of the latter being so parlic- 
ulaily thorough and stimulating as to make the book an excellent 
leferencc or text in advanced couiscs m educational psychology. 

His tioatment, in the fiist chaplcis of tlio book, of "Social Behavior 
and Its Conditions" is without dislinctioii— just another compilation, 
not unusually coherent, of the facts and thcorio,H gcnoially lopoi led in 
social psychologies. It has the merit of being Ihoiougbly modern and 
of containing some valuable and original fonnulations of principles. 
The latter give the impiession, however, of being merely niHOvtcd foi 
good meaauio without affecting the choice of otlioi malerial m this 
section of the book 

But this deficiency in the first part of Clio book is in aharii contrast 
witli thereat of the b.ook, and since the fiist part is fairly lyincal of that 
vast number of texts whoso chief reason foi existence is their clarity 
and modcinity, it forms a handy lofcrcnee point by wlucli to judge the 
superiority of the body of the work. John N Wasiiduuni:. 

Syracuse University 


Manual for Deteimining Ihc Equivalence of Mental Ages Obtained fi om 
Uroup Intelligence Tests, by Koss O. Runnels. Test Method 
Helps, No, II. Yonkers-on-Hudson, N Y. : World Book Go,, 
1930, Pp 14, paper. 

Expressing Educational Measui'es at> Pctccnhlc lianKs, liy !•' G. and 
0 K Buros. Test Method IIelp.s, No. III. YoiikerK-on-HudHoii, 
N. Y. . World Book Co , 1930. Pp. 27, paper. 

It has long been noted by users of tests that tbeio aie gioh.s dif- 
ferences in mental ages and intelligence quotients olilained from 
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different group tests Due to variations in methods of standardization 
and differences between the groups by winch the various tests were 
standardized, n, sad lack of equivalence exists between the tables of 
norms. Dr. llunnela ndministorcd the National, Haggerty, Otis- 
advanced, Tcrinaii Group mid Otis Helf-administering Tests to 1422 
pupils m Grades V to IX inoUisivc The oqiiivalonco of scores was 
determined by equaling percciitilo laiiks For each percentile rank, 
the averago of the mental ages given by the manuals for the vauoua 
tests was taken as the now mental age norm, Of coinse, no such 
proceihire will increase the reliability of a group test, but Runnels' 
tables will bo of groat assistance in obtaining more comparable results 
when a vmiety of gioup tests is used in a school in successive years. 

“Test Method Helps, No II" gives an adinuably clear and simple 
explanation of ranks and percentile ranks and includes tables to aid 
the computation of peiccntilcs when the number of cases is fiom 11 
to 100. For those who arc not adept in the use of a slide rule, tins 
little book provides a quickor and casici method of computing per- 
centile laiiks than has hitherto boon available 

Laubance F, Shapfer 

Carnegie Instilulo of Technology, Pittsbuigh 


Child Adjuslmenl, by Annie Dolman inskeep. New York, D, 
Appleton and Co , 1930 Pp XVI + 247 

A study of tho facts and principles presented m "Child Adjust- 
ment” will enable the teacher and educational specialist to gam new 
insight into tho educational process ns lolated to the growth process in 
the school child The book serves to bring together the major findings 
of many scattered bits of research As the author sta tes in the preface, 
the essential purpose of the book is that of “finding out how the child’s 
body, mind, and emotions differ fiom an adult's, how they develop 
into the adult stage, and how they should be caved for during school 
years." The topics discussed moludo adjustment with reference to 
height and weight, giowUi and functions of the larger muscles, handed- 
ness and foolcdne.s 3 , the inlciiial organs, diffcient developmental 
ages, the teeth, adjustment in relation to growth of braiA and nerves, 
the eyes and ears, adjustment in relation to growth, development of 
the mind, mcnsui orannt of intelligence, ci iticiil adj ustment periods, 
emotional health and mental hygiene In the appendix theic is a 
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discussion of different psychological theories, behaviorism, gestalt 
psychology, Ih^eud, Jung, Adler, psychoanalysis. 

The author shows originality m the methods devised for studying 
different factors in child behavior and makes the mateiial of practical 
usefulness thiough hei descriptions of actual school practice in studying 
the physiological, mental and emotional development of pupils. The 
best sources of scientific data have been consulted and are leferred to 
in each chapter The mierielation of physical and mental factors m 
the child's development is emphasized with each topic discussed. The 
belief 18 expiessed that if the child’s home and school adjustments 
have been made with his physical, menial and emotional needs m view, 
the child makes better progress m his school work Cases of discipline, 
failure, nervous bieak-down, maybe attiibutcd to failuie to understand 
tho child as different fiom the adult. 

In occasional m, stances the leader may feel that the aiithoi lays 
too much stress on physical deficiencies as major causes of maladjust- 
ment, as for example when lying and stealing are found m conjunction 
with adenoids or pooi eyesight, and the behavior defects are attiibuted 
to the physical ones. A tendency to attribute school failure to physical 
defects is implied in the author’s discussion, but theie is also emphasis 
throughout the book on the impoitance of investigating all causal 
factors in an adjustment problem Gertrude Hildreth. 

The Lincoln School of Teachers College 



THE JOURNAL OF 

Educational Psychology 


Volume XXII hrnrcb, 1931 . Number 3 

TIIOllNDIKE’R C.A.V.D. IS FULL OF G 
KAllL J JIOLZINGER 
Univcr'iity of Chicago 

The chief point of this note is to show that Piofessor Thorndike’s 
well-known G.A.V D. Intelligence Test may be thought of as saturated 
with Professor Spearrann’s g rather than with a number of group 
factors. Professor Thorndike’s ratcrprctation of three Spearman 
laws of cognition will also be touched upon This second point is 
doubtless a veiy dangerous one because tho writer is not a psychologist 
and has only a moderate g, while Profcssoi Thorndike is not only a 
pure psychologist, but must have a g that approaches the colossal. 

The data for tho first point arc furnished m Professor Thorndike’s 
Measurement of Intelligence. ‘ Here the C.A.V.D, test is compared 
with other mtclbgcnco oxarainations designated as follows* 


CAVD , , , Xi 

OtiB Sclf-adminiatoring Test Xs 

Tormaa Group Test (Grades VII-XII) . , Xa 

Stanford Binot (MA) . Xt 


The intercorrolations of these foui tests are given by Professor 
Thorndike and may be written m the form 



X, 

X2 

Xs 1 

Xa 

X. 1 


87 

.04 

78 

Xs 



88 

77 

X3 

1 


1 


.77 


The tctiad differences* work out 


huai = 054 ± ,017,^1243 = -.017 ± .010, W = +.037 ± .022 

^Tharndike, E, L . ^^Tho Meaaiiromcnt of Into! 1] gen co ” Bureau of Publi- 
catioTia, Teachera College, Columbia Univcraifcy, New Yoik City. P 9GEf 
^Professor Spearman^s “Abilities of Man “ The Macmillnn Company 

IGl 
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Thepe tetrads may be regarded as statisUcally insignificant showing 
the existence of a common factor g and four imcorrelaied specific 
factors Sv as mdicated by the equations (1) 

x\ = mig + n\Si 

X 2 - mo + ^ z 52 

ics = msff + uzSz 

Xi = TTliO + 7I4S4 

The quantities m and Ux (t = 1, 2, 3, 4) being constants. 

The existence of g being indicated it is now possible to obtain its 
correlation with each of the foui tests (see Spearman Appendix). 
These correlations arc as follows: 

Tia ^ 960, Tig - ,921, rap = .960, r4p == .817 

If the piobable error of these coefficients is of the order .01 or .02 it 
thus appears that C.A.V D. and the Tcrman test aie most highly 
saturated with g while Stanford-Binet is the least effective measure 
of this factor 

In his own analysis of the above coirelations Professoi Tlioindilce 
points out (p 96, op. ciL) that ^'Intellect C.A V.D. is very much the 
same as that which is measuied by representative examinations for 
so-called mtelhgencc ” Professor Spearman’s method of correlation 
with g not only shows that these four tests flie measiuing tho same 
^ intellect" but shows how well each measures this ‘^intellect'’ and 
indicates that tho ''intellect^’ in common may bo regarded as g as 
given m factor pattein (1), This seems to us a great advance over 
the usual ciude methods of validation by conelationa, Tho criterion 
by the Spearman method is a well defined g instead of a subjectively 
labeled test score. 

It IS, of course, possible to interpret the same set of correlations in 
an infinite numbei of ways and to employ an infinite number of factor 
patterns other than (1) A certain western psychologist piefeis to 
think of the variables as made up of an infinite number of independent 
elements even when the tetrads vanish. This is a possible interpreta- 
tion, but Binco it cannot be verified statistically and could be made 
regardless of the relation between correlation coefficients, it seems to 
us to have little scientific value. 

When the tetrad differences do not vanish, group factors are pre- 
sented and more elaborate factor patterns may be employed. Illus- 
trations of this sort are given by Piofeesor Kelley^ and by Piofessor 

^ Kelley, T, L '‘CroBBioadfl m the Mmd of Man ” Stanford Univorsity 
Press. 
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Spearman (?oc. ciL). Bomo of Uie (UlficnUies arising from the nse of 
such elaborate patterns arc the complexity oi total lack of adequate 
piobablc errors to lest the theory, anil the great chfliculty m attaching 
meaning to the numerous factors employed. 

By way of illusliatiiiB tlusse points, wo may lake un oxamplo from 
Profcs.sor Kelley’s book (p. 97tl.). The four tc3t.H used arej 

Xi = lloftibuR speed 
Xi » AritlimcUc power. 

Xt ’= Memory for words. 

Xi “ Memory for meaningful symliols 

The inter corrolntion nnti tetrad dilTercnccs arc ns taken from a paper 
by the wilier *■ 



A. 

I Aj 

A', 1 

Xi 

A', . 

j 

0580 

I 1060 

2000 

A, . . 


1 


2480 

A,.. . . 



j .mi 

0093 


tnai - - 010 ± 037 
tun ^ “ 005 i 037 
hui = .006 ± .010 


From the insignificaiicp of these tetrads wo may conclude that 
factor pattern (1) with only ff common i« suffieicntly complex. If 
group factors are presont in these four tests then effect is insignificant, 
yet Pi'ofo.s30r Kelley oinploys the irattoin given by the following 
portion of hia Table XII (op cil ). NumberB in the table are standard 
deviations 


Toflta 

a »= lieloroRorie- 
ity, i(iAturiiy> 
6CX, raco 

ft “ 

V crlial 
fuotor 

i 

y ^ 

iiuiiilmr 

fiictor 

& « 

, moiu- 

ory 

faclor 

1 

C <=' 

epaiial 

factor 

^ f = 
apeed 
/acLor 

Spot 

Not 

ohnnoo 

Clianca 

1 Heading upocd 

10 

GO 


1 

00 

38 

30 

1 28 

2 Antliinotio ptjwor 

21 


Od 


31 


10 

OQ 

3 MfiTaoty inr 









woril8 

GO 

00 


liO 



30 

33 

4 Memory fur 









mcAningful ayiu- 









bola 

.fiO 

i 


52 

JO 


32 

30 


‘ Halaingor, K. J, fli\ Tntuul TlilTcionocs «f Ovcilapping Variables Join rial 
of Educaltonal Paychologij, Feb,, 1030 
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The above example is but a fragment of Professoi Kelley’s work 
on these data and is not included by way of oiiticism, but merely 
because the numeral work was at hand. As far as these four tests are 
concerned we hold that pattern (1) is adequate Professor Kelley 
employs the elaboiate pattern in the above tabic and interprets the 
common factor a as "heterogeneity, maturity, sex, and race ” We 
argue that the factors a, j8, y, 6, e, f, etc. me insignificant m these four 
tests, and that whatevei common factoi is found may be regaidecl 
'asfif 

At a meeting of distinguished psychologists last year several 
expressed giave doubt as to the meaning of g, they piefened a, 0, y, 
6, e and f probably because specific labels had been attached to them. 
The writei is certainly in doubt as to the correct mterpictation of g, 
but this doubt rises to complete confusion when a half dozen other 
factors are added even though they are shown to bo significant. We 
can at least get the correlation between g and other variables when the 
tetrads vanish and thus approach its meaning. The bases for deter- 
mining the number, numerical value, and meaning of other general 
factors 0, y, S, e, f etc are much more subjective. Such factors may 
need to be added in the analysis of variables, but only when pattern 
(1) doesn’t hold as shown by the tetinds. If they are added their 
meaning should be approached with even greater oaic than the 
meaning of y. 

The whole point of their digression is that when wo do get the 
tetrads to vanish and thus establish the adequacy of pattern (1) wo 
should be very happy about it We have arrived at a simple and a 
very beautiful statistical explanation. We may also, by the Spear- 
man technique, build up a pool of tests concentrated so highly with 
g that we will come to know its meaning more clearly than that of 
tests subjectively labelled. 

It thus appears that Professor Thorndike should bo pleased with 
cur findings. If he ever makes another test more replete with g he 
should be still happier. He should not try to think of the common 
factor as "heterogeneity, maturity, sex and race," but rather have 
these all eliminated and show that g is still there. 

Turning next to the interpretation of Spearman’s laws of cognition 
we may teat these as follows: (1) Any lived experience tends to evoke 
immediately a knowing of its character and experience; (2) the mental 
presentation of any two characteis (simple or complex) tends to evoke 
immediately a knowing of the relations between them. This law may 
be termed Educhon of Relations, (3) the presenting of any character 
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together with any rolatioii teucia to evoko immediately a knowing 
of the correlative cliaracfcer. Tliis law may be called Eduction of 
Comtocs. The word “iiuiuediatG” here iudlGatcs the absence of 
intervening procoaHcs. 

AGcordmg to PvofoRhor Spearman, mtolligonce mcludoB all processes 
derived fiom those tlnoo principles comprising tho ability to appre- 
hend experience, educe rcUilionH and oducc correlates, 

The second of the above? laws may be illusiiatcd by an analogies 
test. 

BaL Ball Ilammo: Boy: Nail Handle: Axe Here tlie characters 
or fundaments aio the seven iloms presented The subject may 
educe vaiious relationH between those fundaments such as: 

13nt 18 naedfor hitting ImlL 
Bat hu8 fia7?i0 letter «« UaU 
Hammer has handle 

Hammer /lae «amc IcUci «« handle 

Hammer w naedfor hUtiug imil 

In addition to lliCBc the subject may educe cci tarn relations between 
the lelatioiis listed above. Those? might iiicludo: 

18 uaedfoT hiding ih unlike has 

t$ used for hiding is same as medfar hiding 

has same imtial letter as is flame as has enme tmlial IcHei an 

Tho correct anawev to the ovigmal lest is arrived at by 

educing some or all of tho above rclatioiifi. Tho question then remains 
what to do with the answer ^Miandle” solootod on tlio bafiis of the same 
imtml letter ns “haminer.^^ It may lie aiguod that both answers are 
coriecfc or that **nail^’ la a belier answer than ‘Miandlo^^ and should 
receive all or at least moie credit than tlie latter. If tho second argu- 
ment is followed, then the subject might educe a relation of the soit. 

^^Use of an object is getiGialhj moic important than tho initial 
letter of the object 

In any case the above example appeal b to involve only the educ- 
tion of simple relations like tho fust five and more complex iclations 
like the last which are clopondent upon tho fiist. 

Piofessor Thonidiko^ has conunonted upon tliesc thice laws as 
follows : 

Thcio is no doubt that Lha appimutioii aiul iiuuiagonu'iit nf roktions is a very 
important featuio of iiitell(M?t, by any M?ast)iuiblo (hdiiiition tiioirof Yet it scoiiis 
hazardous and undesirable to awHimic that tho pouM'ptiou ami nne of rwlations is all 
of intellect In pi notice, tests m pniuf^inpli i cad mg, m information, niid in range 


^Lqc cii , Pp. lQ-20 
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of vocabulary, eeein to signify intellect almost as well ae opposites and mixed 
relations testa In theory, nimlysiB (choosing euitable elements or aspects or 
relations) I and organizing (managing many asbociative ticnds so that each is 
given due weight in view of the purpose of ono^s thought), seem to bo as deserving 
of consideration aa the perception and use of lelationa Moreover, T fear that in 
M. four cases wo need other valuations to decide ivliich are better lolatiojvs, or 
^Tioro absbact lolationa, oi more essential olcmcnts, or tho more sagacious rclatioiiSj 
or the 7rtor6 cousisient oi ganization, or tho more dcsi'TaMe balanco of weights, and tho 
like (Italics are Thorndiko’a ) 

To tliG unpsyohological nuud of the writer the other yahmUons^^ 
cited above are largely, if not cntiicly, eductions of relations between 
lelatiotvs Thus the coricct solution of the Bat : BelU piohlem probably 
rests chiefly upon eduction of the sort. 

uso of nn object ^s more /ani than tlio initial letter of tho object. 

This seems to us just as much an eduction as the case, 

Bat ts Wised for hxiiinq hall 

111 fact nearly all of the “evaluation^' cited by Professor Thoindike 
appeals to us as Spearman “eduction/' 

As a further illustration one may take Professor Thorndike's Task 
1 on p. 163 {op ctL) The subject ia to make a true and aenaiblo 
statement, filling one woid m each of tho blank spaces: “The , . . 
way to . is by airplane/' The filling of these spaces appears to 
involve eduction of relations between fundaments of a sort. Thus 
the second space might be filled with such words as “ travel, cUo, swim," 
oto Likewise the whole new phrase “way to travel ia by airplane," 
or “way to swim is by airplane" may bo treated as a new fundament 
and the first place filled by eduction resulting in words like "best, 
fastest, cheapest," etc. Furthoimore the completed soiies may 
bo related to the fundament “previously experienced sensible fact," 
and several such completed series i elated by the eduction “more 
sensible " Thus the subject may ariive at the sentences: 

1 The quickest way to dio is by airplane 

2 The cheapest way to travel is by airplane, 

3. The quickest way to tiavel la by airplane, 

4. The elowest way to swim la by airplane. 

The choice of the “most sensible" connpletion might bo obtained 
by a senes of eductions between tho above completions. According 
to Professor Thorndike this choice is a matter of “decisions" as to 
“most sagacious" relations, etc. How the aubjoct could make the 
“most sagacious" selection without eduction wc do not see, and if all 
such decisions, valuations and sagaoiousnoss are ruled out of Spear- 
man's laws he has instead of Laws of IntelUgonco anything but that. 



TETllAP-DIFPEllENCES FOE NON-VERBAL 
STJBTESTS+ 

WILLIAM STEPHENSON 

iJinvcifliljy f 'ollpgc, T^ondon 

Introduction 

The work to bo doscubod consliluloH nn inlrodticUon lo intottsivo 
research on qiicstiona of vorlnUity luid IhouKht; but the present senog 
of papers concerns primarily tho satisfaotioii of llie thcoiy of fnclora 
by data obtained by use of voibal and non-verbal subtests. Tho 
question of the factor conloiit of certniu non-verbal subtests is of 
first importance, and is our iinnipdiato concorn; later, wc shall examine 
comparable data for a set of verbal Hubtcsls, and ultimately we shall 
use the one kind of Bubtcsls ns "leforenco values"^ for tho other. 

By verbal aubtcBts we refer to p- tests involving words, or phrases 
or other complex linguistic striictinos as fundaments; the non-verbal 
p-tests aro sot in spalinl, pcicoptual, or pictorial or other osLcngibly 
non-verbal fundamouta. 

Tlic recent rcsoarclics of Line® and Foitea® arc indication of the 
present detailed attention given to non-verbal sub tests. Tho interest 
in such sublosbs follows from Iho theory (and obtained facts) of tho 
universality of tho Spoarinnn p-faclor, that which appears to charac- 
terise cduclive processes’ no matter under what conditions they 
function, The work of Davey’ is recalled, where t!ie g-facLor was 
found to cover pictorial lus well as verbal subteats. But, tho correla- 
tional data gathered liy Envoy, myself,*® Lino, ami Fortes, arc for 
populations of the order 100 only and, lo have a more securo foundation 
of theory and supporting fact, it seems that some data should be gob 
from large populations, of the order 1000 at least. The first objeob 
of the present pnpei is to provide data gathorod from a population 
of 1037 girls 

A correlation tabic foi one thousand population serves at least 
two points of value Wo oxainiiio the lalilc by means of the Spearman 
tetrad technique. In tho firot place, tho Speiumaii Thcoiy of Two 
Additive Factors requires a fit m the toLrtuls lo within sampling error 
value, and, instead of sampling erioi of amoimt 0 03 foi one hundred 

*Wo express our (icep iii(l(‘1)((>(liii'‘ts to Piofrssoi tSpeainmii, utidoi wlioni xve, 
ns Ilcsenrch Assislniit, roveri’d the piosenl woik 

107 
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populationa, we should encountcy sampling error of 0.0095 for one 
thoueand population, (with aubteats of the kind used by us) , Secondly, 
it is likely that any such Theory, dependent as it is upon the use of 
many eubtests, involving scores of test items, and for data gathered 
under complex experimental conditions, will need to take account of 
errors other than sampling error. Particularly will this be so for 
large populations, for resulting small sampling ciroi. It is obvious 
that as the large crrois, such os that of sampling, nie diminished, moio 
and more smallei disturbances will become noticeable, wo expect this 
in our statistioal and psychological material, just as wo do in physical 
experimentation Thus, the second object of oui work is that of 
furthering the investigation of on or in tetrads, other than sampling 
error. As m physics, these eriors should receive consideration m 
detail, before coirelational material is submitted to complicated factor 
patterns of the kind given by Professor Kelley. ^ 

If, from our eon elation tables for one thousand population, the 
tetrad-differences show error in excess of sampling error, then wo seek 
explanations of the excess, and finally may need to make it a subject 
of speoial investigation. If the excess erior has a reasonable explana- 
tion, if it makes contact with expectations, if it can bo controlled by 
other experimentation, then the Theory of Two Factors, built upon 
the tetrad criterion, is still fully acceptable. Indeed, wheievcr and 
to the extent that the excess error can be shown to be reasonably 
expected, the theory would not bo fully acceptable unless such ciior 
did occur Thus, the two objects set for the present papei' — that 
concerning the fif-f actor for a batteiy of non-verbal subtests, foi one 
thousand population, and that concerning eiror other than sampling 
error — ^really supplement each other. 

A few sources of excess erior in tetrads have been suggested already 
in previous papeis. Excessive likeness and accidental linkages between 
abilities, and heteiogeneity of race, age, and sex, were early recognized 
by Spearman as explanations of excess error, Some amongst vcibal 
subtests (attributed to similarity of the fundaments or lelations 
involved) was first observed by Davey,® and later by myself*'’ (attrib- 
uted to scholastic influences, in part when the population is drawn flora 
different schools or districts). Professor Spearman® has noted the 
influence of different scales of scoring subtests, and, unless diflicuRies 
are obviated, estimates an error of 0,01 to 0.02 ns likely to accrue foi 
large populations if the subtests arc variously scaled “Speed” 
preferences undoubtedly are a further potent source of excess error 
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in tetrads. IdioHyjtcmciPh inLiodiiccd into hiihtcsls when tlirac arc 
coDStnictcd by one psyciiokiKist nmy lead to nuor lu the Lctiads Coi 
tlic.so sulito-sls,'® niul exoc-'S errm' may fioni a piojnmiuity 

effect, deiiving from the oidm of iipplicafion of a ballury of .sn})lcHts.>'’ 
Again, thcic is possilihi an inlluenco t'ndiiled in Ic.slinf:; liy gionp.s’ 
Finally, not least of the inllnonces that may lead to oxcito erioi in 
tetrads, llicic aro mmtnkes in calonlational work, teat inaikmi', and 
application, All the above aie lli(' kinds of possilile diHturbunces in 
totiads, influoncch h>admg to eiior in exce.ss of aampliiiR eiior Our 
object is to gntlicr what nifoimalmn we cun about these, and any, 
influences Some may lie of psychological significance as objective 
specificahtics, ^.e., ns a griaip factor or fncioie, others may be trivial 
effects that further cxpeiinienls could ohviate. 

lOxi'Dui.Mi.vrAo AIatmiiau 

The data to bo examined arc for a iion-voibal gtoup test of eight 
subtests, applied by myself to 10H7 girls, Testing wa.s liy groups, of 
about fifty girls per gioup, in elemeiiUuy sclmols * hllnven schools, 
half llienumbci in the legion, weie ilrawii fiom the cenlie of the city 
of NcwcftBllo-on-Tyne (Knghuidj. Tlio sehools, cla.ssos, luimliers of 
girls per class, aie shown in Table f The average ages of the ohiidten 
m the classes is given at the foot of the Table, 

There wcio no exlieme regional (tifferenceH in .social or economic 
status of the po]iulalit)n of girls. 'I'lie schools wme much alike in 
point of teaching conditions and Htluinmenls. Tin* small aiea covered, 
comprising the coiitie and gieatei jiarl of llic city, and the localising 
effect of the city’s adminiHliulioii, combined to give tho popuhuion a 
distinct homogeneity in respect to iiifiucnceM of llie kind just inculioned 

Age distribution is given in T'able II Might huudieil eiglity-seveii 
girls were drawn fiom Slandiiids V and Vlb (roughly eijiml classes), 
nil of age falling williiii lla* range 10 yeais to 12 J 2 ycais at tin* time 
of testing. These give to our work a large mcasuie, of homogonoity, 
BO fai ftB school can be cempnicd with school, in both age, mid educa- 
tional attainments or infiuenees Tlie various cla.sses fiom which 
these girliS came eoiiluiiuvl foity giils lielow ten ycais of ago, and these 
were rclamcd. 'I'o ottset these young bngUt gnls, we look fifty bright 
girls from Standards IVu, of age less than ten yeuis, ami a fuitber 

’The author is iiiiti-litisl (o Uic ('oiiiini(li'i> iiikI lo Mi Wnlling, Diiccloi of 
Edueation. 
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seventy-six (at random from the same IVa classes) of age 10 to 
years Thus, one hundred twenty-six girls were from Standards 
IVa, but a large part of these were of prescribed age lange (10 to 123^ 
years). Of the girls over 12}^ years of age, seventy-five were in the 


Table I 


School 

Number of girla id | 

Total 

per 

Bohool 

Num- 
ber of 
groups 
tested 

Standard 

IVa 

Standard 

Va and b 

Standard , 

' Ylb 

Standard 

Vllb 

A 

28 

40 

1 

2a 


00 

2 

B 


61 

40 


01 

2 

C 


60 

31 


100 

Z 

D 


68 



58 

1 

E 

3d 

05 



03 

2 

F 

10 

53 

41 


US 1 

2 

G 

14 

30 

30 

23 

112 

2 

H 


1 60 

47 


07 ' 

2 

I 


1 34 

63 

1 

88 1 

2 

J 

0 

61 

27 


04 1 

2 

K 

20 

05 



1 

2 

Totals per Q bandar d 4 ^ 

120 

687 

300 

21 

1 


Total all fitandards 


, 

» 1 


1037 


Avoraga age per gir) 

10 yr 2 mo 

10 yr 10 mo 

12 yr 1 mo 

12 yr 6 mo 

1 



Tarle) II — Aqb Distribution for 1037 Girls 


Aan 


(YbaiiS, MoNtbs} 

FUKQOliWCY 

8- 9 to 8-11 1 < 4 

5 

0- 0 to 0- 6 . . 

21 

ft- 0 to 9-11 . , . 

61 

10-0 to 10- 6, .. . , 

111 

10- 0 to 10-n , , ... 

m 

11- 0 to 11- 6 . , . 

200 

11- 6 to 11-11 

185 

12- 0 to 12- 6, . 

109 

12- 6 to 12-11 

00 

13- 0 to 13- 6 . 

24 

18- 6 to 13-11 . , , . 

6 


various Standards V and VIb The girls entered from Standard 
Vllb of one school could be omitted without altering any of the losults 
reported in the course of our woik 

The non-verbal group test was applied in June 1929 Each testing 
group received the verbal group test on one day, followed by tho 
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non-verbal (our paiticular coucorn in the present paper) on the next 
day. AltogeihoPj 1037 girls leceived both group tests. 

The Non-verhal Suhtests — Tlic group test had to be easily applicable 
in forty minutes full testing time. The subtesLs therefore had to be 
of simple con sU action, and we anticipated rathei low inierconolationB 
for some of the subtests; on the other hand wc expected that two of 
the subtests would be fairly highly {/-saturated (No. Ill and No V). 
The names of the subtesls^ in ordci of application to the giils, with the 
time allowance and number of test-units per subtest, were as follows: 

I Alphabet Construction 3 minutes, 10 teal-iinita 

II Code 2 mmutca, 8 lines of code, scoied per halMiac 
III, Filling Shapes 6 minutes, 15 test-units 

IV P%clurc Goinplelion* 3 mum tea, 16 test-units 
Y» Analogies f Form* 3 }^ 2 mmutea, 10 tcjst-unita 
VI, Countmg Cubes minutes, 15 test-units, 

VII XO Series Complelion, 3 minutes, 16 test-units 
VIII , Overlapping Shapes mmutca, 24 test-umts. 

Throughout our work, we shall lefer to these subtests by the Roman 
numerals I, 11, etc. A brief description of each sub test follows; 

In subteat I the teatco was given a capital letter, and m imagination a piece had 
to bo cut away, leaving as remainder any other capital letter If R was given, 
P could bo tho loqiiucd response I's wore debarred, the given letter could be 
unusually orientated (ns A thought of aa V), and ono, two, or moic pieces could 
bo cut away (in imagination) The given loiters were of simple printing, three- 
fourths in oil high. A sample test-unit is shown in Pig 1, m which three different 
responses are expected Tho capitals used wero, m order, X, U, A, H, B, S, Q, 
P, W, B, and the number of responses expected m each wore 1, 1, 1, 2, 3, 2, 3, 6, 3, 
and 8, respectively In marking wo allowed one mark each for test-units 1, 2, 3, 
and 0, and two marks for the rest, Nos 4, 6, 7, 8, 9, and 10 In the latter teat- 
units one mark was allowed for half or more correct responses, In explaining tho 
subtest, whioh appears to be 1 caddy understood, use was made of sample capitals 
Y, D, and M, providing V, h and C, and V and N, respectively The sarnples 
were worked thiough on a black-board, following a standard procedure 

Subteat II was the Code of tho National Intolhgcnco Group Test, a sample of a 
Similar kind of subteat being worked through on the black-board 

Subtest III can bo undcistood by referring to Fig 2 Thiee small shapes are 
given (togethei, to the left), which, when properly fitted together, form the larger 
shape (on tho right) Lines had to bo diawn in the larger shape (right) to indioato 
how it could bo cut to give tho thieo small shapes A correct lesponse lequired 
the drawing of no moro than two or thzco lines in any test-unit Pour sample 
teat-uiuts wero woikcd tiuough on tho black-board 

Subtest IV was of tho usual pictiuo completion typo, for example, a cup may 
bo given winch is minus its handle, and the testec la icquired to indicate the 
missing part 
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Subfcost V, an Analogies! subtest, made use of eliapea and Imea xu various 
relations one to another A sample test-umt is given jn Fig 3 The task oi 
explaining the subteat^a requirements was rendered easy l)y referring the girls to a 
verbal analogies sub test given to them on the previous day 

^ (_)(_)(_) 

1 2 3 

Figure 1 


Figure 2, 

Subfceafc VI was a modified form of the Am ci lean Aimy sub test of this namo 
Siibkest YII, a series completion subtest, can bo undoi stood by rofeinng to 
the sample below 

XXOXXOXXOXXO 



Figure ^ 


Noi. □ □ Aoo 


Figure 4. 



The four dashes had to bo filled in eo as to continue the senes, X 0 X'^ being 
the required responses in tliis sample. 

Subtest Vlir required a little more preliminary explanation than was needed 
for most other sub teats. Figure 4 shows the type of test-unit. All the shapes 
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overltipping tho 1 Imd to bo iiulicatccl Ity cancolhng the appi opi late shapes adjaceat 
to No. 1 on tlio liglit A large square, a long rectangle, a long tlun timiiglc, a 
circle, and a '‘Rve-aidcd” figuro (legular pentagon), were tho shapes made use of m 
each test-unit. In tho case of tho sample shown in Fig. 4, the square, triangle, 
and eirelo, required cancelling. 

Tito subtests have been dc,seribcd for adult understanding, but the 
testing directions were much more cliildliLcc and concrete Applica- 
tion was standardised to an easy facility, and the subtests were given 
with this regulanty llnoughout. Each aubtest was piefaced by a 
forc-pracfcicc of six or so tost-units, worked through on the class 
black-board, altogetlier fifteen minutes of the foity minutes testing 
time was so spent in giving directions and working the sample test- 
units, Eor each subtest the girls were allowed about fifteen seconds 
to settle to be ready for the command "Go,” each girl fingering the 
page ready for turning (cyclostylcd sheets, stapled in the top left- 
hand corner, nie quickly turned over, leaving the subtest exposed), 
and weie brought to a stop with an energetic “Stop” command I 
had gioup-lcsLed many hundreds of boys and girls previously, 

Subtosts I, II, IV, and VII, occupied one sheet of paper each (quarto 
size), whilo tho I'ost required two pages each; but in the lattei cases 
the two pages of test-units faced each other, and appeared to the girls 
as one double-sized page in each case. Theic was, therefore, no page- 
turning during tho time allotted for working these subtosts. 

Enquiries elicited that no gioup tests had been applied to these 
gills previously, 

iNTiancouniiLATioNs AND Tetbad-dipfeubnces 

Interoorielations for the eight non-verbal subtosts were first cal- 
culated for crude scores, using the formula for differences (Kelley® 
p 180) All calculations wcie checked in venous ways, but tho ques- 
tion of mistakes receives attention later. Table III gives the product- 
moment correlations for the eight non-verbal subtests, with age, foi 
1037 girls. These we are to consider in teims of the Spearman Theoiy 
of Two Additive Factors. 

When wo arc concerned with tetrad-diffeiences for a table of intei- 
corrclations, we calculate onc-half the number of tetrad-diffeiences 
possible for tho table (the other half aie identical in value, but of 
opposite sign) Tho inean of this balf-nurabcr of tetiad-differences 
IS thus the average or mean deviation about the mean of the observed 
differences. 
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For the theoretical PE of the tetrachdiffer cnees we use formula 
16 A (Spearman/ p, xi) Poi exact comparison with this theoretical 
PE we calculate the observed probable error, given by 0.6745 V" 
where t stands for ''tetrad-'diffeience,” and n is the number of tetrad- 
diftcTencea. 

If ^^normal'* probability chstnbiition obtains for the obsorved 
tetrad-diffeiences, the above mean deviation about the mean of the 
observed tetiad-diffeiences, multiplied by 0 8453, gives the value of 
the probable erioi for these obseivcd tctiad-diffcrcnccs We antici- 
pate that this latter value should be appioxunalely the same as that 
given by the sigtna above 

For any get of tetiad-dilfcienccs, then, wo can give (and it is our 
usual practice to do so thioughoufc oui woik) the following values' 

(a) Tiio mean of the halNnumbci of tetiad'diiTcicnccs, sign being disicgaidecl 
This IS the mean deviation about tho mean, oi average, of the full sot of tetrad- 
difforcncesj when regaid is paid to sign, the aveiago of the full sot being J^eio 

(b) The piobahlo erroi of the dilVercnccSr calculated irorri the above 
i e j from tho mean deviation, i,e , 

= 0 8453 X Mean deviation 

(c) Tho piobable error of the differences, Calculatod from the ohaoivcd aigma 
of the differences, i e , 

= 0 6745\/ll* 

’ n 

(d) The theoiQtioal probable error, always expicssed as PJ5, given by equation 
16 A (Speaimau), 

From Table III, before age is partiallod-out, we obtain the following 
results for the tetrad-differences. 

(a) Mem of 210 tetiad-diffcrenoea , 0 0232 

(b) Observed jie, fiom mean X 0 8463 , 0 0106 

(d) Tlieoietical PE * . . , , , 0 0005 

If we partial out the age correlations, the new intercoiielaiions for 
the eight non-vcibal Bubtests give the following lesults 

(a) Mean of 210 fcetrad-dilYcrenceg, age pai tiu,lled-out coi ic- 

lations , . 0 02266 

(b) Observed piobable eiror, from 0,8463 X the above iimau 0,0191 

(c) Observed probable error, from 0 6746 X sigma 0 0184 

(d) Theoiotical PE . , , . , . . 0 0094 

Thus, as a whole, the mtercorrelations show evior in excess of that 
expected as sampling error, tho excess being of tho order 0.016 Pur- 
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ther, age has no significant influence on the tetrads heie considered. 
Our immediate pi oblcm, then, is the attempt at location of this residual 
excess crroi 


Location op the Excess Errou 

When the totrad-diffeiences show excess error it is our first object 
to tiy to explain the excess, in terms of specificality, ^^e., of a group 
factor 01 faclois, oi in termvS of extraneous influences, such as calcula- 
tion mistakes. Some possible spccifi call ties and influences have been 
described in the Iniioduction 

Without going into details, it may be said lieie that there is no 
evidence that any of the influences mentioned above (with exceptions 
to be considered below) have singly pioduced the residual erior, 
Thus, the effect of testing by gioups was found by me to be here with- 
out influence on the tetiads* Again, subtests III, V, VI, and VIII 
have somewhat similar shapes as fundaments, but there is no evidence 
of a broad gross specificality because of these fundaments Subiesis 
III and VIII involve very similar geometrical figures as fundaments, 
but specificality is not shown by We guarded against ^^pio- 

pmquity ” influences in oui testing procedure, although we would not 
be quite ficc fiom an habituation distiiibance for or 
From the way in which the interesting subtests (judged from the giils^ 
altitudes towards the tests) weie introduced in the battery, and fioin 
the shoit testing time entailed, we can neglect possibilities of fatigue, 
subjective or othciwise, cnteiing our material No matter what wc 
attempt, we can not isolate any single coirelation and submit that it is 
associated with the laiger, oi greater part, of the excess error shown 
by the tetiada. Thus, in a pieliminaiy search for possible disturb- 
ances there remained two for consideration, fiist, the possible calcula- 
tion mistakes, second, the possible error introduced by dissimilai 
scales, by faults in scoie distributions. 

If, by lecalculatmg intercoiielations for new scales (a new dis- 
tribution of scoies foi each subtest, without distorting the sense of the 
scores), we finally rid the tetrad-differences of excess erior, the whole 
procedure will be open to the criticism that the mtercoi relation table? 
vaiy slightly one fiom another, due to calculation mistakes, so that 
the final removal of the excess eiioi’ would bo considered to be merely a 
happy chance m the calculations. But, at least, we shall sec the extent 
withm which such variations due to calculation mistakes can bo 
taken to be of influence in our work; and, should our proceduie show 
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orderly diminution of the observed tctrad-diffcrcnccs, some evidence 
will have been obtained for a fair meaeure of soundness in the calcula- 
tions, and for the supposed influence of the irrcgulai clistiibutions 
of scores 

The Suhtesis Rescaled. — Wc proceeded m two stages. First it 
woB thought perhaps sufficient to lesealo the sub teats so as to give 
approximate “normal" distributions of scores for the 1037 girls 
When it was found that this approximation faded to give the expected 
improvement m the error shown by totiads, we subsequently converted 
all crude scores into a “standard” normal distribution, the same for 
each subteat. Using new coirelations for seven of our subtesta, each 
subteat having an approximate “normal” scoio distilbution, gave a 
mean of 106 tetrad-differences of amount 0.0229; this is to be com- 


'EXBliC III — PaOBCGT-MOMBUT CQR«®nmtJNS TOR N OP 1037. Grcoe SCOBEa 



pared with the value 0.0234 observed foi the same seven subtests 
with the intercorrelations of Table III The average of the twenty- 
one mtercorrelations for the new table was 0,3698; the conespoiiding 
average for Table III is 0.3614 (subtest VI omitted). Thus the 
rescaling to an approximate “normal" distribution (amounting to 
removal of any "skewness”), does not nd us of the excess error m the 
tetrads. Nevertheless it perceptibly altered the mtercorrelations, 
in the direction of a smoothmg-up of the table of mtercorrelations, 
giving better “hierarchy.” It appeared that just another such slight 
smoothing would bring the totrad-diffeiences to within sampling 
error values 

fQf It 18 not expected that crude scores should have much more exact 
"normal" distributions of scores than those obtaining for our sub- 
tests, But the number of girls given zero score m particular subtests 
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IS fiequontly dispioportionately large and, when the test-units of a 
subtest aiD nob sufficiently smoothly graded, the short timc-allowancc 
per subtest tends to accentuate tho frequency of certain scoies Dis- 
tuibances of this kind may hide the geneial results that aie our 
concern, To take into consideration influences of this kind wc con- 
sidoied it worth while trying our data with new scales, this time fitting 
each subtest to a more exact “normal’^ distnbiiUon, the same for each 
subtGSt. 

For convenience the six siibtosts I, II, III, IV, V, and VIII wcie 
made the subject of Ihc now convcision The crude scoies which 
supplied Table III wcie now converted to fit exactly the following 
approximate “jioimaF^ distribution. 


Score 

0 

E 

I 

3 

4' 

5 

0 

tI S 

0 

le 

11 

12^ 

13 

14 

I 

I 

1 

Ficqiiency 

3 

1 

I 

34 

48 

70 

98 

H8|l35 

134 

118 


n 

48 

24 

I 

I 

1 


The method Ufecd in conveiting the ciude scores will be understood 
by referring to the following example of the proccduie 

The crude scores and frequencies for subtest I were as follows: 


Cruel 0 scoics 

0 

1 

2 

3 

etc. 

Frequouoy , 

2 

10 

27 

32 

oto. 


Of the ten giila obtaining crude score 1, one was chosen at random, 
and her scoie was reduced to :iero [making, with the two having zeio 
crude score, the three ncw-scalo 0 scoies required for the '^normaF^ 
distribution (for convenience wc name this distribution the '^standard” 
one)] seven of the girls retained their score 1 (now taken as new-scale), 
and the othoi two received new-seale score 2 We now require four- 
teen more new-scale 2^s. these wore taken at random from amongst 
the twenty-seven having ciudo score 2, leaving thii teen. The thirteen 
are acci edited with a score 3 on the new-scale Similarly eleven of the 
thirty-two crude score 3^s are given new-scale 3’s, and the rest arc given 
ncw-scalo i's This process is repeated up to tho maximum score, 
17 new-scale, all the selections within a particular crude-score being 
made at random, It is obvious that the new scaling is icasonable 
in that it does not distoit the sense of the subtesis, and it is valid, 
having in mind the arbitraiy system of allotting crude scores 
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The six subtests so rescaled provide the inter coi relations given in 
Table V, age being neglected. (It seems that age influence, for all 
our tables of correlations, ^vould intiodiice at most about 0.005 error 
in the tetrads See in this connection Holzingcr/ p. 28 ) The sub- 
tests give tetrad values as follows: 

(а) Mean of 46 tctiad-diffoipnccs for Table V 

(б) Obscivod probable eiror, given 7ne(ui X 0 &453 

Obseived pe, given by BJgraa X 0 6745 , 

id) PE 

These values show xmpiovGment when compared with coi responding 
tetrads for Table III But the impiovement is greater than the 
above observed probable enoi evinces One correlation, rn^vm, 
has associated with it the larger of the tetrad- differences. If we omit 
the twelve tetrad-differences involving this correlation, we aie left 
with the following 

(fl) Mean of 33 tctrad-dilTei cures for Table V, omitting 


0 0104 

(6) Observed probable euoi, given by mean X 0 8463 0 0088 

(c) Observed pe given by sigma X 0.6746 0 0080 

id) PE 0 0005 


The observed probable error (0 0088) is now attiibiitable solely to 
sampling error It seems that the improved distribution of subtest 
scores has removed crroi in the tetrads, other than sampling, and tliat 
due to na we see from a eompanson of the values at (a) with 
corresponding tetrads for Table III. Thus the forty-five comparable 
tetrads for Table III (crude scores) have the following values: 

(d) ilfean> forty-five tetiad-differeeces for Table III, 0 0244 

(6) Obsei vod pe (mean X 0 8453) , 0 0206 

id) PE 0 0100 

Again, if we omit from these foity-five tetrads the twelve that involve 
the correlation Tnyrm loft witli the following values, foi com- 

parison with the observed probable eiior of amount 0 0080 for Table V : 

(o) Mean of thjiby-tliiee tctrad-diETcrenccs, for Table HI, 


Bubtests I, II, III, IV, V, and VIII, omitting rjj ym 0 0191 

(i) ObsGTved probable enoi, given by mean X 0 8453 0 0159 

(c) ObsexTcd piobablo enor, givon by sigma X 0 6745 0 0109 

W PE nearly , 0 oo98 


0 0188 
0 0159 
0 0171 
0 0006 
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Values quite similar to these for Table III weic obtained also foi 
the table of iatoicoi relations alluded to at the beginnmg of this section, 
whore seven subicsts were icscalcd to an approximate "'normal 
distribution of scores. Tlie value 0,0169 at (c) above is for ciude 
score coiTclationa, whilst 0 0080 at (a (c)) is for "standard normal 
probability distributions of subiosl scores; wc conolude that the 
improved distiibution of scores lias removed excess cnor in the tetiads 
(excepting ^ti»vin)* The influence of the crude scores is likely to be 
of amount 0.0149 (given by V" 0^0169^ ^ 0l)080^). This, we note, la of 
amount esUmated by Professor Spcaiman as likely to acciuo for large 
populations if subtests arc variously sealed as mentioned in the 
Introduction to this aiticle. 


Table IV — Muanb and Sigmas or tub NoM-vEfiDAL Subtebts, fob N - 1037, 

Giuls 


Siibtcab 

Mean 

Sigma 

Maximum scoic 

I 

0 89 

1 

i 2 32 

16 

II 

7 01 

2 22 

16 

III 

4 48 

1 87 

16 

IV 

4 64 

1 88 

10 

V 

7 07 

8 00 

16 

VI 

[ 3 81 

2 47 

13 

VII 

' 7.33 

1 00 

13 

VIII 

8 07 

2 09 

17 


We conclude, then, that the observed probable error given at (a) 
above for Table V, is as low as wc can reasonably work for, and the 
tetrads provide sampling error differences only; to complete this 
conclusion, however, we must explain the excess error apparently 
shown by the correlation ^n.vin Further, it appears that the rescal- 
ing, to fit a "standard “noimaP^ distribution of scores, has effected 
the improvement in the cnor shown by the tetrads In this connec- 
tion we should note the following contiibutoiy evidence The means 
of the corresponding in ter correlations in Tables III, that alluded to 
for seven subtests with approximate "normaP^ distributions, and V, 
are 0.3614, 0.3598, and 0.3527 respectively — these values, wc suggesli, 
offer an example of the fair quality of the calculations, and this 
receives confirmation in other directions, for msLance, fiom. the 
objective spccificality (consicleied below) for 
readily consider that a happy chance has resulted m the impiovement 
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shown m the observed erroi at (a). Calculation errors iheie aro, no 
doubt, but they are too fine to be significant m our tetrads 

To complete our account of the factor content of the non-veibal 
subtests we require to explain the excess erior apparently shown 

Constdeiation of the yni Specificahty » — One would not place too 
much regal d upon a single case of diveigonce from sampling orroi 
values, and usually the details we are about to give would scarcely be 
necessary. But, the excess error attributed to can receive a 
simple explanation, and the spocificality can bo shown to be objective, 
it la a matter of importance to rcpoit the data concerned, for reasons 
connected with the acceptability of the Two Factor Theory for our 
data^ for the contact it inakca with the investigation of eiror other 
than sampling error, and for the evidence provided of the objectivity 
of the coi relational values under consideration. 


Table V — Puoducmioment Coriielations Non-veiiumj yuiiTEBTs, with 
Scoheb Concerted to a ‘^Standard Normat^ Phobahility Distiudution 

N = 1037 Girls 


Sub lest 

II 

III 

IV ! 

1 " ! 

VIII 

I 

3'lft3 

4121 

1 3274 

3733 

3207 

II 


348'1 


3121 

3707 

III 



4110 

4711 

3608 

lY 




3771 

3012 

V 





3278 

VIII 







We have suggested that ?ii ym is the source of excess eiror in Table 
V We do so by noting that the largest tetrad-diffeicnccs for Table V 
uniformly involve this conelation Tetrads of the following type 
are then isolated, and omitted fiom the main body of tetrads 

{rAB fxv) “■ (TAx fay) \ y,, 

(tab r^v) - rjir) = J ^ ^ 

(where Vab is suspected for excess error, and where ^ and y are any 
other subtests, taken two at a time, regard being taken of the sign of 
the difference). The twelve tetiads of this foim for Tab = tu,ywf 
for Table V, have mean of amount +0,0420, 

Now, there is evidence from other sources that strengthens the 
claim of the ?ijvni excess enoi to a fan degieo of objectivity The 
evidence is as follows: 
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In lihe table for crude scores, Table HI, lias the largest mean 
associated with it, for Ictiads of form (1), namely an amount +0 035, 
Again, conelations woikccl for a sub^population of two hundred girls, 
a selected gioup with ages ranging 10-9 years to 11-3 years at the time 
of experiment, gave the following results: 

(ft) Mean of two hundred ton Lcliact-dilTcrenceB, sub-popu- 
lation of two hiiiulicd, oiglit non-verbal flubtests , 0 0319 

(b) Obeorved probablo oner, given by mean X 0 8453 0 0270 

(d) PE 0 0230 

There aic thirty totrads of foim (1) for Vn^yui m this two hundred 
ten tetrads, with mean of value +0,0737; the omission of these thirty 
from the full table of tetrad-differences leaves the following results: 

(a) Mean of one luindrcd oigliLy fcotiad-diffcrcnccs, sub- 

population of two liundied girls 0 024.8 

(b) Mean X 0,8453 . , 0 0210 

(d) PE . . ... 0 0230 

Other correlation tables, for fcub-populations of one hundred girls, and 
live hundred girls, gave similar results* The most noticeably large 
tetrad-clifferoncos always involved the correlation the 

omission of this correlation left tetrads with sampling error values 
only. The result shown for Table V, then, is not particular to that 
table of coviclationa* The excess error associated with rn^vnr is 
independent of the scoiing methods used in our work; and the obser- 
vation of its influence is undoubtedly repeatable, t.e,, objective. 

An acceptable specificality between the two subiests II and VIII 
can be explained in terms of a “quantity-work,^' oi “speed," prefer- 
ence The Code subtest (II) may be liable to a pionouneed prefer- 
ential attack for “speed" as against “quality," Subtest VIII would 
seem to entail a similai pieference on the part of the testecs One girl 
may diligently ensure that each test-unit in Bubtest VIII is completely 
and surely answcicd, all the oveilapping shapes being sought for. 
Another girl may be satisfied if one or two overlapping Bhapes are 
found, and would spend no time m a search foi further shapes The 
former may respond to five test-units only, maiking probably fifteen 
figures that overlap, without a single crior or omission; the latter may 
1 espond to all twenty-four test-units, marking foi ty overlapping figuies, 
but with not a single test-unit correctly answered A differential 
influence of this kind has been obseivcd frequently m other work, in 
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researches made in our laboratory "With our present mateiial, wc 
have a test of the "explanation”, and we next give this attention. 

Sublest VIII was scored for quality (Qj completeness of answer), 
and for quantity (y, total number of shapes conectly indicated, coi- 
rccted for chance correct responses). The scores wcic added, giving 
equal weight to each, and (Q + q) was then the crude score for subtest 
VIII, used 111 all work described in the previous sections The sep- 
arate Q and q scores, however, give us the following additional data- 

(1) The correlation a rn,® tind rn^g aio 0 4088 and 0 8217 respectively 

(2) fQq IS 0.8506 

(3) Using tliG <3 ficoie onlyj fcliD following now coi relations were calculated, all 
scores being set on the ^'stnndaid*^ normal distribution excepting Q 

^ 0 , 1 , ’Q.v, having values 

0 3230, 0 3217, 0 3216, 0 2052, and 0 3232, lespcctivcly llcplncmg tlio 
correlations foi subtest VIII m Table V by the coircspouding ones given 
above, gives a new set of tctrad-diHei cnees, with value as follows, 

(o) Mean of 46 tetrad- differences, Table V, having Q in- 
stead of YIII 0 01621 

(6) Obsoivcd probable or roi, given by wean X 0 8453 0 0128 1 

(c) Observed probablo error, given by sigma, X 0 6746 0 0128 [ 

(d) PE nearly . . 0 0006 J 

The twelve tetmds of fo\m (1) fox the coirolation 'iji.Q have moan of valuo 
0 0261 Tho above vaUies should bo compaied with the values given at (/3) on 
page 178, " and the mean 0 0261 likowise should be compnicd with tho mean of 
0 0420 given on page 180, for tho tetrads of form (1) involving rii,o and rn^viii 
respectively^ The \iso of 0 gives lower on or m the tetrads, 

(4) With tho correlations ftlroady piovided, it is poasiblo to calculate tho 
following correlations 

^11,91 ^ni.w 

Those have values 0,2940, 0.4088, 0 3619, 0 3142, 0 3074, respectively As at 
(3) given, we replace tho coirolations for tho subtost VIII m Table V by those q 
coTTclatioiis Tiic resulting table of corrolationB provides Porty-fivo tobiad- 
differences, with value much the same as those given above at (3) for the Q corre- 
lations, except that the t^Yolvc tetrads of form (1) have moan +0 0646 Thia 
value should be compaied with the 0 0261 for the (3"men8ure tctiads of foim (1), 
and with the (Q + q) monsiiro value of 0 0420 

Thus, it seems, from the conBideration.q we have given of tho matter 
m the above paragraphs, that the spccificality shown by Jn.vm has a 
fair degree of satisfactorincas, owing most to a common influence 
between subtest II and the q (quantity) measure of tho subteaL VIII. 
Tho excess erroi for the letrad-dlflcrenees of Table V, which wo asso- 
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ciatecl with J'livm, is shown above to be repeatable and therefore 
objective (witlun the limiLs of our data for the 1037 girls); similar 
crior has been found in otlicr work, in which a similar explanation in 
terms of a “speed” effect has been offered; the explanation seems 
reasonable for the two sublcsls conccincd; and it leceivcs expenmental 
support from the Q and q conclntions. Thus, the specificality 
is well authenticated. 

Further, this “speed” specificality seems to bo the only one that 
can be isolated for Table V, llclevanl to this conclusion we should 
add the following details. 

One may envisage a complicated cancelling, m the tetiads for 
Table V, wheioby tho eorielalioiis J,nvi and J'lfv,,,, canoel 

out (except for the latter) any influence that each may have separ- 
ately towards excess crior. If we omit all tetrads involving these 
four correlations, wo arc left with only eleven of the forty-five tetrads 
for Table V, with mean of amount 0 0083, observed probable error 
of 0,0069, theoretical PE of 0.0094 But avo are not justified in 
suggesting the isolation of correlations that already give only samp- 
ling error value to tetrads. However, so fai we have been critically 
concerned with only six of oui eight non-verbal subtests; if need be, 
we could widen our data by including the two subtests so far not 
rescaled, Iheieby pcrhap.s obtaining further infoimation about the 
effect of any, or nil, of tho four correlations considoied above. There 
IS reason to suppose that if sublests VI nnd VII wore lescalcd, they, 
too, would fall into line with tho values and characteristics shown by 
Table V; thus, subtest VI ivns included m the coirelation table alluded 
to in 11)18 article under "The Sub tests Rescaled” (foi the seven sub- 
teats with approximate “normal” distiibution of scoica), and it fits 
the tetrads as well as any other subtesfcs; and, further, subtests VI and 
VII had clearly tho most irregular crude scoic distiibutions, which 
amply cxplnm the con elation anomalies they show m Table HI 
Until we find clear need to seek furthei information about the above- 
mentioned correlations, or any others, we propose being satisfied with 
the data obtained already for the six subtests in Table V 

The correlation requires a raomont’s consideration because 
of contact made with it iii the course of vvoik to be dcsciibed in a 
subsequent papci Wo may state, without going into details (a 
matter that can be examined by anyone so interested, since all the 
necessary data aie provided in tins paper), that ?i„,v m in no way 
singular m its clTcots in tetrads No mattei from what angle we exam- 
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ine our data, we obtain no evidence in support of specificality for 
r,„„. Parenthetically wc should add that in any detailed examina- 
tion it should be remerabered that the Q measure for subtost VIII is 
biased for quality (with the narrow conception given to this woid, 
namely, "completeness of answer"), and this slightly disturbs corre- 
lations with Q Any need to consider r,j,,v (or fini, ^'lu.iv nto*) as a 
possible souice of excess error, is lemoved if the Q oi q scores are 
neglected 

We conclude that rit,vm, m Table V, alone involves acceptable 
specificality. 


ll^isuMfs A-ND Conclusion 

Commencing with the interoorrelations of Tabic III, which piovido 
an observed probable eiror of 0 0196 for their totrad-differences, wo 
have endeavored to locale error of amount about 0.016 in excess of 
that expected for sampling error (0.0006). If we were able to explain 
the excess error satisfactorily, then we are left to conclude that the 
interoorrelations for the non-veibnl subtosts liavc good agieoment 
with the Theory of Two Additive Factors 

Of first importance is the question of our calculation mistakes. 
The sequence of error for tetrads for Table III, that alluded to for tho 
seven subtests with only approximate "noimal" score distiibutions, 
and for Table V, as well as the play of eiror for the vaiious niQuences 
considered in the pi evious section are the evidence that we offer of the 
quality of our coiielational calculatioua. Wo cannot hope to be free 
entirely of calculational error; but, we add, the correlation calculations 
should be accepted even if our tetiad calculations are found slightly 
inaccuiate, because the coirelationa have leceived tlio greater atten- 
tion Further, oui data are lodged permanently in the Psychological 
Laboratory, University College, London, and aie available foi anyone 
to rework. 

Neglecting possible calculation mistakes, and age influence (which 
IS no doubt present, but introduces veiy little erroi, of amount 0 005 
at most), we account for the excess erroi of Table III tetrads as 
follows. 

First, there is eiroi introduced when the sublesl scoi'es are not 
distributed satisfactorily "normally," When tho crude scoies aic 
converted to fit a "standard" noimal probability distribution, the 
excess error is removed, except for a amgle specificality that can be 
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isolated and cxplnmod Neglecting this Binglo specificality gives an 
observed probable cnoi of 0.0081, for a theoretical PE of 0,0095, 

We show that this single specificality, for r,,,,,,,, la objective, and 
acceptable as the only Bpcciflcnlity among our non-verbal subtesfcs. 

The Theory of Two Additive Factors therefore fits well with tho 
observed lesults for our non-verbal subteetB, allowing for We 

explain the intoicoi relations in terms of a common ff-fcclor, and factors 
specific to each subtoat (with spccificalily for The {/-factor 

we take to be Ibiit fiist observed by Piofcssoi Spearman, the factor 
that appears to eharactoiize lelation and coiiclato eduction. Thus, 
the {/-factor hitherto observed for non-verbal subtesta for small 
populations, is hero aliown to obtain for one thousand population, 
Finally, conccimng our sccoml object, that of knowledge of error 
other than sampling on or, wc can hcie eay that the facts can best 
be given on completion of our work, with the verbal subtests considered 
in addition to tho non-vcibal At this junctuic wc note that, accept- 
ing our correlations, it is possible to observe the influence of non- 
normal distribution of scoiCR for the subteels. Our second point of 
note is that we isolate a single specificality, attributed to a "speed pref- 
eionce " Such n "speed" effect must be looked foi m all woik with 
(/-tests; and the influence must be kept in mind particularly in our work 
with the vcibal sublcsts 
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A COMPARISON OF 'WHITE AND NEGRO Cim.DREN: 
NORMS ON MIRROR-DRAWING FOR NEGRO 
CHILDREN BY AGE AND SEX 

R J. CLINTON 
Oregon Stalo College 

A gicat deal lias boon writlen and said by way of coinptiiing the 
white and Negro races, both in mental ability and motor ability 
Ragsdale* said that there was not much difference in the ability of 
white and Negro boys, m the rate of tapping, “although theic seems 
to be a slight tendency for white boys to bo supeiioi at the later ages." 
He found that there was not much difference in the rate of lapping 
of white and Negro giils until the ninth year when “white girls are 
consistently superior m lapping rate ” Waltner** states; "This study 
of the learning capacity of Negroes ns compaied with whites finds the 
power to form sensory-motor coordinations by Negroes to be about 
72 8 per cent that of whites.*’ 

Bardin^ obseived that the anatomy and physiology of the Negro's 
brain hindered him m leaining Jordon’s* personal observation was 
that the learning capacity of the Negro could bo determined by the 
darkness of his skin. Phillips^ suggeslcd ictardalion as a culcriou 
for judging the ability of Negro childieu. 

Schwegler and Winn** studied a group of 58 Negro boys and girls 
and a like number of white boys and girls in the Junior High School 
of Lawience, Kansas The selection was by chance. They state; 

Thoro Bcoms io be nn timniatakablo chfforonco in the inioUecUial hfo ol tho two 
groups skiiched Tho median intellectual endowment of tho colored gioiip is 
about eight-flvc per cent of that of tlie white gioup 


1 llagsdalo, C E . “Psychology of the Ncgio “ Thesis, Univoiaity of Missouri, 
p. 144 

^"Waltner, Eima ^'Psychology of Negio “ Theaia, Univeisity of Missouri, 
p 36. 

^ Bardbi, J , Factors m the Southoin Kace Problem P Sc M ^ 1913, Vol 
LXXXIII, pp, 368-374 

* Jordon, II E r The Biological and Sociological Worth of tlie Mulatto 
P. Sc. M., Vol LXXXIII, pp. 573-682 

® Phillips, B A Kctcntion m Elcincntaiy School of Philosophy Psucho- 
logwl CtiniG, Voh Yl, p 79 

« Schwegler, R. A , and Winn, Editli Compariaon Study of White and Gobi eel 
Children Journal Educakonal Eeaearchf Vol II, pp 838-847, 
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The wiiter became interested m the studies cited and desired 
to make a comparison of the abilities of white and Kegro children’ 
in mirrow-dr awing, motor speed as shown by marking, and letter- 
forming speed as shown by writing, as well as to make some compari- 
sons of the mental abilities of the two laces 

By means of the use of the Otis Self-administeiing Teat of Mental 
Ability, the writer made a comparison of the mental abilities of an 
unseleeted gioup of white high school pupils, and an unselected group 
of Ncgio high school pupils. The one hundred fifty-five white 
high school pupils gave a mean IQ,^of 100 6, and the one hundred 
twenty-two Negro high school pupils gave a mean IQ of 84 5 

Methop of the Study 

The mu roi -drawing equipment® consisted of a stationary mirroi 
on a drawing board, and a small shield to prevent the subject fiom 
looking directly at the hand while worlang The mu roi -drawing 
pattern consisted of a two-oirclc pattern with numbers from 1 to 24. 
Numbers 2, 5, 8, 11, 14, 17, 20, 23 make up the small inner circle, 
and numbers 1, 3, 4, 6, 7, 0, 10, 12, 13, 15, 16, 18, 19, 21, 22, and 24 


TaBLII I. — CoMPAKIBON OF WlIITB BOYS AND Ne QRO BOYS PHOM SiX TO SEVENTEEN 
Years of Age in Mirror-dr awing 


White boys 

Negro boys 

Ago 

Numboi 

Mirroi- 
di awing 

Ago 

Nnmbei 

Mil ror- 
d rawing 

6 

38 

4 7 

G 

19 

1 7 

7 

36 

0 6 

7 

21 

2 9 

8 

49 

9 1 

8 

25 

8 2 

0 

27 

9 4 

9 

28 

6 8 

10 

43 

10 6 

10 

22 

7 2 

11 

30 

14 0 

11 

21 

9 7 

12 

40 

14 7 

12 

28 

8 3 

13 

32 

15 8 

13 

28 

8 2 

14 

44 

20 1 

14 

10 

16 2 

16 

34 

22 4 

16 

23 

10 8 

16 

40 

24 9 

10 

16 

9 3 

17 

49 

30 8 

17 

10 

16 6 


* The wiitei included 691 Negio children m this investigation 
^ Clinton, U J Natuie of Mirroi-dr awing Ability Norms on Minor-drawing 
for White Childien by Age and Sex Journal Educabortal Psychologih Mar,, 1930 
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make up the laige outer circle The subjects wcie instructed to draw 
a continuous line from 1 to 24, cutting the small dot at each mimber. 


TahiiE II — CojiPAHisoK OP VViiiTB Girls and Neqko Girls from Six to 
Seventeen in Minnon-DiiAwiNO 


White giih j 


Negro girlH 


Ago 


Miuor- 

cliawiiig 

Age 

Number 

Miuoi- 
<1 rawing 

6 

28 

2 9 

0 

17 

1 

7 

41 

4 9 

7 

18 

4 9 

8 

63 

6 9 

8 

24 

3 7 

9 

28 

8,3 

9 

32 

4 6 

10 

44 

8 9 

10 

37 

0 9 

11 

49 

10 0 

11 

29 

5 3 

12 

40 

13 8 

12 

28 

7 2 

13 

37 

10 1 

13 

46 

8 1 

M 

67 

22 6 

li j 

18 

7 7 

16 

61 

30 7 

16 

30 

9 2 

10 

48 

31 4 

16 ’ 

21 

23 1 

17 

49 

38 6 

17 

16 

20 1 


Tablh III. — CoMPAnisoN OP White Boys and Nboho 13oyb from Sia to 
Seventeen in Markino Speed and Lettbu Making Speed 


White boys 


Negi 

0 boys 


Ago 

Number 

Maiks 

Let tern 

Ago 

Number 

Mai kti 

Letters 

6 

38 

119 

61 


19 

98 

45 

7 

36 

121 

74 

7 

21 

113 

71 

8 

i9 

153 

123 

8 

25 

163 

84 

9 

27 

100 

160 


28 

160 

118 

10 

43 

195 

179 

Bfl 

22 

107 

141 

11 

30 

203 

191 

11 

21 

102 

146 

12 

40 

223 

200 

12 

28 

21G 

100 

13 

32 

243 

228 

13 

28 

222 

183 

14 

44 

252 

234 

14 

10 

229 

197 

16 

34 

204 

241 

15 

23 

264 

209 

16 

40 

271 

260 

10 

16 

26d 

234 

17 

49 

285 

268 

17 

10 

248 

230 


The score was the number of lines completed in a five minute period 
The writer designed a mirror-drawing pattern to use m Grades I, II, 
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and 111 which included the figures from 1 to 15 The figures were 
so placed that the small children had no difficulty in locating them. 


TabijTi IV — CoMPAiiiaoN OP Wiii'MS Girls and Negro Girls prom Six to 
Seventeen in Maukinq Speed and Letter Making 


Whito giih 

Negro girls 

Age 

Number 

Maiks 

Lcttcia 

Age 

Niimhoi 

Marks 

Lottors 

0 

28 

112 

62 

G 

n 

102 

06 

7 

41 

147 

96 

7 

■■ 

136 

105 

8 

63 

104 

137 

8 

24 

161 

122 

9 

28 

103 

176 

9 

33 

175 

138 

10 

44 

212 

194 

10 

37 

202 

163 

11 

49 

217 

207 

11 

20 

208 

160 

12 

49 

228 

227 

12 

28 

231 

199 

13 

37 

249 

260 

13 ! 

40 

223 

200 

14 

57 

263 

208 

14 

18 

236 

230 

16 

61 

270 

272 

15 

30 

238 

231 

10 

48 

271 

274 

16 

24 

264 

250 

17 1 

49 

274 

280 

17 

15 

266 

251 


Table V — Norms for Nbguo Boys and Negro Girls in Mirhor-drawinq, 
Marking, and Lbttbu Making 


Negio boya | 

Negro girl a 

Age 

Minor- 
di'a^\ ing 

Maika 

Letters 

Ago 

Minor- 

drawing 

Marks 

Letters 

0 

1 7 

98 

46 


1 

102 

66 

7 

2 9 

113 

71 

7 

4 9 

130 

106 

8 

8 2 

153 

84 

8 

3 7 

161 

122 

9 

6 8 

169 

118 


4 6 

175 

138 

10 

7 2 

167 

141 


0 9 

202 

163 

11 

9 7 

19S 

mm 

11 

5 3 

208 

16G 

12 

8 S 

210 


12 

7 2 

231 

199 

13 

8 2 

222 

183 

13 

8 1 

223 

206 

14 

16 2 

229 

197 

14 

7 7 

236 

230 

15 

10 S 

264 


15 

9 2 

238 

231 

16 

9 3 

263 

234 

16 

23 1 

204 

260 

17 

16 5 

248 

263 

17 

26 1 

206 

261 


The two mirroi -drawing patterns weic evaluated on compai able groups 
m order to get continuous norms thiough all ages fioin six to seventeen 
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The Tables I and III show a coinpai isoii of the ability of white and 
Negro boys from six to seventeen years of age in miiTow-drawiug, and 
in making speed and letter making. Table II and IV show a compari- 
son of the same abilities between white and Negio girls from six to 
seventeen years of age Table V shows the noima in inn jor-dra wing, 
marking speed, and speed in making letters for Negro boys and girls 
fiom six to seventeen 

Conclusions Pnoii 'rnn Study 

1. Unselected white high school pupils arc supeiior mentally to 
unselected Negro high school pupils, as shown by the tests 

2. In the simple motoi process of maiking, there is not much 
difieience between the wliite and Negro chiUlien. 

3. In wiTting, which icquhes a grontor degree of motor-sonsoiy 
coordination, the superioiity of the white children is clearly shown. 

4. In the complex motor-gensory cooicliuation process of mirrov- 
drawmg, the white children arc consistently supeiior to the Negro 
children, 

6. The ability to do mirror-drawing mci oases rather consistently 
from year to year with Negio children, as well as with white children. 



A STUDY IN REVERSING THE HANDEDNESS OF SOME 
LEFT-HANDED WRITERS* 

NOllMA V SCHBIDEMANN 
'Umvciaity of Soutlicm California 

AND 

HAZEL COLYER 
Los Angeles City Scliools 

The subject of handedness has long been of interest to psycholo- 
gists, neurologists, eugenicists, and popular wnteis, Reference to 
piofcssional liteiatuie will show that the classioom teacher of the 
primary grades, who has the best opportunity to observe hand piefer- 
enccs in non- established or poorly established activities, has taken no 
especial inteicst m the subject. The majoiity of elementaiy teachers 
of a decade ago seemed to have a single rule in establishing writing 
handedness — all children must write with the right hand. Many 
left-handed adults tell us of exciutiating ordeals they wore required to 
undergo in trying to “break up” left-handed tendcnoies The 
majority of elementary teachers of today likewise scein to have a 
single rule in regard to establishing handedness in wilting— the iight- 
handed child should wnte with his right hand and the left-handed 
child should be permitted to write with his left hand. 

That a child upon entering school, in his eagerness to do exactly 
the right thing, may be influenced by unimportant factors so that ho 
may show an unnatural hand preference foi writing movements is 
usually not recognized. A child’s lack of ciitical judgment is mani- 
fested constantly in his imitation of non-consequential factors in hopes 
of attaining significant traits or habits. Thus, a child may quite 
confidently try to smoke in Older to become manly like father, or 
try to walk pigeon-toed m order to bo like a greatly admned friend 
Imitation of hand pieference for wiitmg may also be made by con- 


*Thra study was made duung the second scmestci of 192C-10SO lu the second 
grade (IIB) of the Mehoso Avenue School, Loa Angeles City Schools. Tins 
Boliaol Ja located m a icaidcntinl diati'ict of Hollywood The clnlclion aie noi- 
innl cluldicn and come fiom much above iivctiigo homos 

Mis Colyci, tho second grade toncliei of the gioup studied, interviewed the 
liaienta ot tho chiUlron and earned out all the remedial piocedure in eahnblislung 
a rcvoisal of handedness in anting 
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scioi:is imitation of an admiicd playmato or tcachci or by vincoiiBcious 
imitation when the ohild is anxiously trying to follow, in most minute 
detail, every movement of one demonstiating a desired habit or skill. 
That first grade children may show unnatural hand piefercnccs for 
writing and that the primary teacher may unwittingly mistake these 
unnatural preferencea for innate dominance, was lovealed m a recent 
study of a group of loft-handed writers ^ 

Of a second grade group of thirty-four children, sixteen wcic left- 
handed writers Both the fiist and the second grade teachers of the 
group were left-handed; the chiklien^s wiiting habits were established 
before they enteied the second grade. The impiobability of so high a 
percentage of left-handed clnldicn in an unsclcctcd group of normal 
individuals led to a study of those children in ordei to deteiminc, if 
possible, the native handedness of each left-handed wiitei and to effect 
a reversal of handedness in cases where that might seem wanantable. 

Since no single test has boon devised whereby a child^s native 
handedness can be definitely discovered, each child was given a soiies 
of tests, one for eyedness and nine for handedness Native eyedness 
IS perhaps the best single indication of a child's natively dominant 
side. Study of bodily asymmetry has resulted in the recognition of 
dominance of one side of the body over the other, that is, individuals 
are cithei dextroexpert, gcneinlly, us to oar, eye, hand, and foot, or 
else they are simstroexpert ^ 

Hand- and foot-prefeienccs are subject to training, but eye picfer- 
ence, except for accident or disease, lemains uninfluenced by expoii- 
ence. Hence tho eye test was considered the cntorional test for native 
handedness, but it was not consideicd justifiable to effect a reversal 
of handedness on the basis of eyedness only Thoio me many degrees 
of native handedness, that is, some indiVKluftls aie strongly right- or 
left-handed; efforts to reverse their hand preferences aie of no avail 
and may even be followed by unfortimato consequences Others 
are so mildly left- or light-handed that they change their preferences 
with the slightest training Mildly left-handed individuals, because 
they wish to conform to the majority and because most appliances 
are designed foi right-handed individuals, usually picfei to tiaiii their 

1 Sohoidemann, Norma V ! A Study of tho Ilniulrdnrss of Soiuo Tjoft-liandrd 
Writoia The Pedagogical Hvmimty and Journal of OcnetiG Psychology ^ Yol 
XXXVII, Deo. 1930, pp 610-lG 

® Gould, G H “Right-lmndcclucss and Loft-lmiidoducfls " Lippiiicotfc, 
1908, pp 18'20 
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right hands. Children showing consistent right hand preference m a 
series of tests for handedness and left eye preference in tests for eyed- 
ness may well be peimitted to establish right hand writing habits. 
About twenty-thieo per cent of piesumably right-handed children 
have been found to be left-eyed ^ In regard to left-handedness asso- 
ciated with righfc-eyedness Ballard^ found that of fifty-one left-^handed 
individuals fifty-seven per cent proved to be right-eyed, Quinan^ 
found fourteen such individuals in a group of twenty-eight. Parsons‘S 
found only foui such cases among six bundled eight right-eyed 
ohildion These findings made us cautions of hasty diagnosis. 

Por this study seven of the eight tests used by Hacfncr® in dis- 
covering the composition of hand dominance of a gioup of children, 
and an additional tcst| wore selected as being suitable for discoveiing 
hand piefcrencc Each test was given thiee Limes, the hand used m 
two of the trials was iccorded as the child’s prefeired hand ® In 
summary the tost used for handedness were as follows 

1 Culling — The oluld was lequirccl lo pick up a j)au of scissors placed dneotly 
before him and to cut very caiefiilly along an irrcgulai lino diawn upon a sheet of 
paper The hand holding the soibsors was recorded 

2 Winding , — A long coid ftv^jtoacd to a pencil and placed diiectly before 
the child IIo was then icqiiiicd to wind the coid abouf; tho pencil The hand 
doing tho wincluig was recorded 

3 Throwiyig — The child wns icqiincd to tlnow a soft ball lo tho e\aminGr 
Tho hand used to throw was rcroidcd 

4 Receiving , — The child was given a small object Tho hand with which the 
object was received, was lecoidcd 

6, Easy Reaching — The child was leqimod lo icach foi a ball placed diiaefcly 
before him on a tablo The liaiid used was lecoided 

^ Mills, Lloyd Byedness and Handedness Aiacncaii J ournot of OjihlhahnologVj 
Vols I-IX, 1925, pp 106-*H3 In this study one liiuulied eighty left-eyed children 
weio found among seven hundred cighty-foui pie 3 umal:)ly ught-handed oliildiea, 
Paisons, B S “Lefthandedness.” Maeniilinn, 1024 Paisons claims that 
about thnty per cent of all individuala are left-eyed and would be left-handed 
weio it not for the operation of social pressure 

^Ballaid, P B Smisti all ty and Speech Jourml of Ezpeiwi^ntal FedagogHi 
Vol I, 1911-1912, p 298 

^Quinan, C ; A Study of Sinistrality and Muscle Coordination ui Musicians, 
Iron-woikois and Ofcheis Archives of Neuiologf/ and Psgchialncs, Vol. VII, 1922, 
pp 352-300 

^ Parsons Op at , p. 107 

^ Haef nor, Iltvlph * ' Tho Educational Sigiufieaiico of Lcf t-hmidccl ' Te aeh- 
ora College Conti ibutione to Eduentioni No 300, 1929 

® This method of scoring was used by Uifc, J M Types of Dextiality. Psy- 
chological Review f Vol, XXIX, 1922, pp. 474-480 
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6 Energetic Reaching — Thu child was requn cd to roach for a ball placed at a 
distance requiring an energotio reach. The hand used was recorded 

7. Up — Each child was asked to fold hia hands by mtci clasping hiB 

fingers The thumb that was placed on top was recorded 

8 Balling — Tho child was required to hold a hnt ready to strike a ball about 
to be pitched by tho examiner The hand that was neaier tho batting end of the 
bat was recorded. 

The test for eyednesa was as follows: 

9 Eyedness , — A sheet of paper with a small hole torn in tlio center was placed 
in tho child’s hands at about a loot or a foot and a half from liis face. A bib of 
crumpled paper was placed upon the floor Tho child was directed to look through 
the hole at tho bit of crumpled paper Without permitting tho child to move the 
eheob of paper, tho exammor placed her hands nUernafccly over tho child’s loft 
and right eyes Tho child reported whether or not he was able to see tho bit of 
paper when one of hie eyes was covered Failure to see tho bit of paper, mdicated 
that the dominant eye was covered 

These nine tests were given to the sixteen left-handed writers. 
The following table gives the results of the test findings. 


Hand- and Ete-puhfehencbs of Sixtbun Lbft-handbd WniTnna of a Second 
Grade Group of Thtuty-four Nohmal CuiLDutJN 


Teat 


1 

% 

Carl 

Shirley 

Marvin 

Yvonne 

1 

fi 

73 

1 

i 

Roberta 
— 

Jack 

Melville 


Ceefle 

s 

Anita 


Cuttmg . , . 

R 

L 

R 

L 

R 

R 

E 

R 

L 

L 

R 

L 

R 

L 

R 

R 

Winding 

R 

R 

R 

L 

R 

L 

R 

L 

L 

L 

L 

L 

R 

L 

R 

R 

Throwing. . , . 

R 

L 

L 

R 

R 

R 

R 

R 

L 

L 

L 

L 

R 

R 

R 

R 

Recewmg 

R 

L 

R 

R 

R 

R 

R 

R 

L 

R 

L 

R 

R 

R 

R 

R 

Easy reaching 

R 

L 

R 

R 

R 

R 

R 

R 


L 

L 

L 

R 

R 

R 

R 

Energetic reaching 

R 

L 

R 

R 

R 

R 

H 

R 

L 

L 

L 

L 

E 

R 

R 

R 

Thumb up 

R 

L 

R 

R 

R 

R 

R 

R 

L 

L 

R 

L 

R 

L 

L 

R 

Batting 

R 

R 

R. 

R 

L 

R 

R 

R 

L 

L 

R 

L 

R 

L 

L 

L 

Eyedness 

R 

L 

L 

R 

R 

R 

R 

R 

L 

L 

R 

L 

R 

R 

R 

L 


Aadotdmg to the test findings, we felt confident that ten of these 
sixteen left-handed writeis should be using their right hands for wilt- 
ing, namely: Ervin, Shirley, Marvin, Yvonne, Vera May, Richard, 
Melville, decile, Mary, and Anita. Carl and Jean, were, perhaps, 
very mildly 'left-handed and under other eonditions would undoubtedly 
have established right-handed writing habits. 

Before any procedure to reverse the handedness of any child was 

begun, the second grade teacher called the mothers of the children 

\ 



















Beversziig the Handedness 


195 


to the school individually The situation was explained and the series 
of nine tests was given to the child in the mother's presence so that 
the mother could see her child’s hand prefeience in acts othei than 
wilting In all oases the mothora weie very much interested and m 
all but one case, were eager to cooperate in reversing the child's handed- 
ness ID wiitmg, 

The particular methods employed in effecting a reversal of handed- 
ness were different for each child Some children needed scarcely 
more than an explanation and some enthusiasm over the early right- 
handed writing attempts. Other children requued more encourage- 
ment, frequent reminding, and general procedures for training the 
right hand much like those given to beginning wiiters In many cases 
the first attempts with the right hand were better than the child's 
left-handed writing Most of these children were using their right 
hands easily and naturally within two oi three weeks, and all but one 
wore doing so at the end of the semester (after a period of six weeks), 
A few weeks after the opening of the fall semester, the teachers of the 
children whose handedness had been reversed wcie visited and ques- 
tioned m regard to the handedness of the children All the children, 
but the one who had had difficulty in the spring semester, were using 
theu' right hands. 

During each conference with the mother and later during a ques- 
tioning of the child, an effort was made to determine the factors that 
might have influenced the child in using the left hand for writing. 
The immediate influences for left hand writing m the ten cases defi- 
nitely right-handed and the two cases who could use their right hands 
to advantage, seemed to be as follows; 


Influenced by Ictt-hnadednesa of 

First grade teacher . 1 

Mother , , . 1 

Playmates or class-mates ... 4 

Statement of second grade teacher 1 

Influence not known , B 


It is of interest to note that in four cases the mothers did not know 
that their children weie writing with the left hands. The slight 
incidents that caused some to use their left hands is noteworthy 
Thus, when the second grade teacher remarked; " Wc seem to have an 
epidemic of left hands," one boy decided he, too, would use his left 
hand "just to make one more." Another child said she began to use 
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her left hand because her playmate broke her light arm and found it 
hard to use her left hand for willing. The child said she did not want 
“to be caught like that.” 

Although the left-handedness of the first grade teacher was found 
to bo a direct influence in establishing but one case of left-handed 
writing, still we may safely assume that indirectly the teacher’s 
left-handodness played a very impoitant rdle in establishing left- 
handed writing habits among these children, A left-handed teacher, 
especially, if she had unhappy experiences or difficulty in tiying to 
establish right-handed wilting habits, is, perhaps, moic apt to permit 
a child to establish left-handed habits than is a right-handed teacher 
Left-handed teachers may be prejudiced toward having a child use 
hia left hand just as right-handed teachers may be prejudiced toward 
having a child use his right hand. 



THE SIGNIFICANCE OP A DIFFERENCE BETWEEN 
“MATCHED” GROUPS 

B. F LINDQUIST 
State Univoiaity of Iowa, 

A type of oxpeiimenlatlon very frcquontly employed in education 
and psychology is that which makes use of what are commonly known 
as "matched groups,” or as "matched control groups " It is the 
purpose of this article to diaw attention to an important error in statis- 
tical analysis that has boon almost universally characteristic of the 
reports of such experiments, and to suggest an improved statistical 
procedure and discuss its possibilities 

In order to remove any possible ambiguity that may surround the 
term, "matched gioups," it may be well to begin with a specific illus- 
tration. Let us considei an experiment to determine the relative 
effectiveness of the "additive” and the "take-away” methods of teach- 
ing subtraction in third grade arithmetic The usual procedure in 
such an experiment would consist, briefly, of teaching one group of 
pupils by the "additive” method and another group by the "take- 
away” method and then of securing, after the period of instruction, a 
final measure of ability in subtraction for the pupils in both groups, 
The method then considered the better would bo that under which the 
pupils showed the higher average finol ability in subtraction 

In order that this pioceduro be most valid, it is essential that all 
factors influencing the final measure, except the one factor under 
investigation — ^that of method, be kept as nearly as possible the same 
for both groups One of these factors most important to control is 
that of the initial ability of the pupils to profit by instruction. To 
control this factor, it is customary to "match” the two gioups with 
respect to some measure of initial ability This is done by so selecting 
the two groups that for each pupil in the fiiafc group theie exists a 
corresponding pupil m the second gioup identical with him with 
respect to this initial measure. In the case of this specific illustration, 
this initial mcnsiiie might have been the scoie on a general intelligence 
test, or the score on a survey test in arithmetic, or some other similar 
measure. If the intelligence test score had been used, the two gioups 
would Jittvo been so selected as to have identical distributions of 
intelligence test semes — m other woids, they would have been 
" matched ” on the basis of intelligence. 
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Now ill 18 a well known fact that, even though the two methods are 
equally effective m general (x e., for the entire population of Grade III 
pupils), a difference in the average final scores of the two matched 
groups would almost invariably be found in a single experiment of this 
kind. Assuming equal "true” effectiveness, this would nevertheless 
occur because the experiment dealt with limited samples, and because 
differences due to chance in the selection of the samples would alone 
account for different performances on the final test in subtraction It 
is therefore the leaponsibility of the expenmenlor, before drawing 
any general conclusions from a single obtained difference, to demon' 
skate objectively that the difference he obtained was larger than could 
reasonably be accounted for by chance, or gatnpUng, errors. To do 
this he must know how large la the expected value of the difference 
that chance alone would account for in an experiment of this kind. 
In other words, he must know the Probable Error of the Difference. 

In nearly all reports that have yet been made of cxpeiiments of 
this type, the formula that has been employed to determine the value 
of this probable crior has been the familiar PE^m foimula 

PE„„ = (1) 

in which the PE’s under the radical aie those of the respective means 
of the final scores for the two matched groups, each of which have 
been found through the use of the formula 

PEam- 0745^ (2) 

This Formula for the PiohahU Er’ior of the Mean Is Not Vohd for 
Use with Matched Groups,^ — It is based upon the asaumption that the 
samples used are strictly random selections from the populations they 
represent This assumption is not applicable to matched groups. 
The process of matching on the basis of a measure which is correlated 
with the final measure destroys the randomness of the samples with 
respect to this final measure The probable amount of sampling error 
in the obtained difference, instead of being as largo as that indicated 
by the formulas given above, is usually considerably less, in some 
cases by more than fifty per cent. 

The reasonableness of these last two statements may bo made more 
clear by the following iHusbration, based in part upon the one previously 

^ Ikcopt la the very ra\e case wKcie th^ mcaavircs wsad iov inaiclung show no 
corrolfttiOR with the final measures 
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used. Suppose that a large number of samples, each of the same size, 
and each strictly random (not matched), were selected from the entire 
population of Grade III pupils. Suppose the pupils in each sample 
were taught undei identical conditions by the same method, and then 
measured by the final test in subtraction Variations in sampling 
would then result in a variation in the values of the mean scores of 
these samples on the final test. The standard deviation of these mean 
scores would bo the standard error of any one such mean and, m this 
case, since random sampling is specified, this standard error could be 
validly measured by the usual formula for the standard error of the 
mean. 

Now let us considei a similar case, but one in which “matehiug” 
18 involved. If, in the first case (of random aaraplmg) an intelligence 
test had been given to the same samples, a variation would also have 
been found in the mean scores on the intelligence test, again due to 
sampling errors. Now since intelligence is correlated with scores 
on the subtraction test, a sample that duo to chance showed a relatively 
high mean score on the intelligence test would also show a relatively 
high mean score in subtraction. If, therefore, a change were arbi- 
trarily made in that sample so os to bring the moan intelligence score 
down to the moan of all samples, the effect would be to bring the mean 
subtraction score of that same sample nearer to the mean subtraction 
score of all samples than it was previously (in the case of random 
sampling). A restriction of the variation in mean intelligence scores 
to zero (the effect of identical matching) therefore has the effect of 
decreasing the chance fluctuations in the mean subtraction scores 
In other words, the effect of matching is to reduce the value of the 
standard error of the mean subtraction score of a sample. The amount 
of this reduction would depend upon the dogiec of relationship between 
intelligence scoies and subtraction scores, 

What 13 needed, therefore, is a new formula foi the standaid erroi 
of the mean of matched samples that takes into account this restrictive 
influence of matching upon chance fluctuations m the mean. The 
type of reasoning aheady indicated led the author to suggest the 
problem of deriving such a formula to Mr Samuel S, Wilks, a graduate 
student in mathematical statistics at the State University of Iowa 
As a result the desiied formula was obtained, and is as follows* 
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m which represents the standard error of means of matched groups. 
It will be noted that this formula differs from the usual formula only 
m that the right-hand member is multiplied by the radical 
in which r is the Pearson producb-inoinent eoeffioiciit of correlation 
between the measures used as the basis for matching and the measures 
for winch the mean is computed. In the case of the illustration, r is 
the correlation between intelligence test scoics and subtraction 
SGOiea 

Since the original derivation of the formula by Mr Wilks, tho 
author has devised a simplei foim of proof, which is reproduced here. 
This proof is not mathematically so iigid as that piovided by Mr> 
Wilks, but it will perhaps prove easier to understand for the reader 
not highly trained in mathematical statistics,' For the sake of further 
simplification, this proof will be here set in terms of the specific 
situation already used m the pievious illustrations. 

Suppose that wo have, foi a veiy laige number of pupils selected 
at random from the Grade III population, the scores on an initial 
intelligence tost and the scores on a final subtraction test given after 
a couiae of instruction by one of tho two methods described From 
this large group it would of couise be possible to select a number of 
pupils all of whom made exactly the same score on the intelligence 
test These pupils would then bo ‘^matched” on the basis of intclU- 
gence. It would then be possible to picdict, without direct calculation, 
the standard deviation of tho scoias of these selected pupils on tho 
subtraction test. This could be done through the use of the familiar 
standard eiror of estimate formula 

0-^' = o-^a/i (4) 

in which (T^f represents the standard deviation of subtraction scores 
for the selected pupils, <ra represents the standard deviation of subtrac- 
tion scores for all pupils, and m which r^a ropicsents the coriclation 
between mtelligeiice scores and subtraction scores 

Now, instead of thinking of the scores of individual pupils, suppose 
that we have, for a veiy large numbei of samples^ all of the same 
size and all selected strictly at random from the Grade III population, 
the mean scores on tho intelligonco test and on the subti action tost. 
Again, as in the case of individual pupils, it would bo possible to select 
a number of samples all showing the same mean score in intelligence, 

' The ongmal, anil moro rigid inatliGmatioal dorivatiou of tlio fonmila will be 
found m an ariiclo by Mr V/iike in tbis copy of the Journal, 
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These samples would then be ‘'matched ” with respect to intelligence. 
Again It would be possible, through the use of the standard oiror of 
estimate formula, to predict for these selected samples the standard 
deviation of mean subtraction scores This time, however, formula 
(4) becomes 

<rM,> — 1 — (5) 


in which aMj represents the standard deviation in the mean subtiaction 
scores of the selected (matched) samples, in which aru, represents the 
standard deviation in mean subtraction scores for all samples, and in 
which represents the coefRcient of correlation between mean 
scoies in intelligence and mean scores in subtraction for all random 
samples 

Now the standard deviation in mean subtraction scores for all 
random samples is given by the usual formula for the standard error 
of a mean 


a It, 


Vn 


( 6 ) 


m Tvhioh cTe lopresents the standard deviation in the subtraction 
scores of individual pupils in a sample, and in which N represents tho 
number of pupils in the sample. 

The coefficient of correlation between the means of a series of 
samples has been shov/n by ICclley^ to be equal to the coefficient of 
correlation between the scores on which the means are based Hence, 
in tins case, 

^ *= \a (7) 


in which r,, represents the correlation between intelligence test scores 
and subtraction scoies 

By substituting from (6) and (7) in (6) we secure the formula 






( 8 ) 


which, by dropping the subsenpts peculiar to the illustration, becomes 
the formula already given as formula (3), 

Substituting the value of the standard erroi of the mean of matched 
groups as given by formula (3) in the usual foimula for the standard 
error of a diffeicnce between means, we secuie the following as the 


^KcUcy, Trumft,u L , ^^SiatisUeal Method'* P 178, formula (118) 
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correct formula to employ for determining the standard error of a 
difference in obtained mcana for two matched gioups 

where <ri and «rj represent the standard deviations in final seoi os of the 
respective groups, whore Ni and Nc represent the number of cases 
in each, and whore ? lopicsonts the Pearson product-moment coef- 
ficient of eorrelation between the measures used as the basis for match- 
ing and the mcnsurCB between which the final comparison m means is 
made. 

It is obvious, from an inspection of formula (9), tlinl the tuie 
standard oiror of an obtained difference between matched groups 
might be considerably less than that yielded by tlio usual formulas, 
and that hence many differences whicli have been con.siclcred account- 
able for by sampling cnois might liave been statistically significant. 
Fortunately, the incoriect use of the formulas based on the assump- 
tion of random sampling resulted in errors only in the direction of 
conservativeness. That fact, however, is no valid excuse for their 
continued application, especially when the correct technique pioves 
BO simple in application. 

It is important to nolo that formula (9) docs not depend upon the 
relation of the mean initial scores of the matched groups to the “true" 
trutial score of the entire population which is being considered For 
example, if the matched samples of the oiiginal illustvation had due 
to chance been above or below the average of all Grade III 
children in intelligence, the formula would still apply This follows 
by analogy from the fact that the standard error of estimate formula 
applies to all values of the variable fiom which the estimates are made. 

The proof of formula (9) that is contained in this aiticle also 
suggests tliat the formula applies even thougli the exact distribution 
of initial scores is not the same for both matched groups, if only their 
mean initial scores are the same, This indicates that the formula 
should be valid for use with groups that have not been matched " pupil 
for pupil,” but in which the means and standnid deviations alone have 
been equated. A moie rigid mathematical proof of this pioposilion, 
however, should bo piovidecl before much confidence is placed in it. 

It is also important to note that formula (9) does not indicate 
how far the obtained differcnco between two matched samples is 
likely to deviate from the difference that would have been obtained 
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had the entire population been measurecl, but tells only how far the 
obtained difference is likely to deviate fioiu the difference that would 
have been found between infinitely large groups showing the same 
disinbutton of imhal meamres as that matched samples that were used 
Where the purpose of expciimentation, however, is simply to deter- 
mine (as IS usually the case) whether tlicie is or is not amj real differ- 
ence between the two methods of loarnmg or teaching {% c., whether 
or not the obtained diffeicnce is statistically significant, and wheie 
the absolute amount of the difference for the entiie population is not 
demanded) this latter caution is not of very great piactical impor- 
tance If, for example, a method is truly superior for pupils at one 
level of intelligence, it is certainly likely to be superior foi pupils at 
another level not far removed from tho first If icasonably largo 
samples are used {N > 30), and if tho first sample is selected loughly 
at random fiom the entire population and the second matched with 
it (a usual procedure), it is not reasonable to suppose tlmt the difference 
m intelligence between the matched gi’oups and the entire population 
(due to sampling ciror in the fiisL sample selected) will be large enough 
to have any effect upon the validity of conclusions concerning the 
geneial relative effectiveness of the methods investigated 

It should haidly be necossaiy to point out that foimiila (3) is 
useful only to measure sampling fluctuations fiom sample to sample 
in the means of samples that have been matched with respect to a 
related variable It in no sense, therefore, supplants the usual foi’ 
mula for the standard error of a mean, since that formula is m no case 
valid in the specific situation to which foimula (3) applies, Aa far as 
most piactical applications aro concerned, formula (3) need not con- 
cern. the investigator at all, formula (9) being the only one that need 
be directly applied in the usual ^‘matching ” experiment In the case, 
however, wlieie the effect of the methods compaicd is to result in 
diffeient values of the con elation coefficient between initial and final 
measures for tho two gioups, it is necessaiy to apply formula (3) 
independently to the mean of each sample, and then substitute the 
resulting values for the standaid enois of tlie means in the usual for- 
mula for the standard error of the diffeienco hoi inula (9) is given 
m combination foim for the svUiation where any difference in method 
docs not SGiiously affect the con elation between initial and final 
scoies, which condition usually exists Even though the value of ? 
IS slightly different for the two gioups, formula (9) will still yield a 
useful and close approximation to the true standard eiior of the differ- 
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cnoe. It la considered desbable to propose formula (0) in combmafion 
form smce it ehmmatca the necessity of calculating the standard error 
of each mean independently, and hence avoids the danger that fhn 
less critical investigator will attempt to interpret these stand nrrl 

errors m the way ia which the uaual standard error of the 
interpreted. 



THE STANDARD ERROR OF THE MEANS OP 
“MATCHED’' SAMPLES 

SAMUEIi S WILKS 
State UniYoraity of Iowa 

The problem of determining the variation in the mean of one 
character of the items of a sample when the distiibution of another 
correlated charactei is made identical for all samplcsj item by item, 
with an aibilraiy distribution, was suggested to me by Piof. E F 
Lindquist of the State University of Iowa A discussion of the use 
and importance of the tliooiy as a statistical technique in ceitam 
types of experimental work will be found m an article by Lindquist 
in this issue of the Journal In this papei I shall consider only the 
mathomatical derivation of the cxpicssion for this vaiiation, 

In orclei to state the pioblcm more acciuately, we may desciibe 
the typo of sampling involved m the following manner. Suppose a 
sample of N items is diawn from a population m such a way that the 
distiibution of a particulai character X of each item is made identical, 
item for item, with a given X-distiibution. This selection oi matching 
of X's IS made at random lelative to a second character Y and the only 
case of geneial intciest is that in which there is a coiiolation between 
X and y The question iiatuially aiiscs: What is the expected varia- 
tion in the mean' of Iho F’s duo to such samiiling? It should be noted 
that the given distiibution of X may be of an arbitiarily selected form 
or it may be deiived at random The results, as we shall see, are 
independent of the form of this distiibution 

Let ua assume that X and ¥ aio noiinally distiibubcd, and that a 
con elation of ?• exists between them As was previously stated, we 
can obtain moic general losult.s at once without making this assump- 
tion of normality, but it is the first one made because of the gieatei 
practical interest in the case of a normal distribution For con- 
venience, let us think of the X-Y plane as being divided into small 
squaies Then in any finite sample of N items there are only a finite 
number of squaies into which the points {x, y) (each representing an 
item of the sample) will fall. The distribution of 7's associated with 
a given value Xp of x which is taken as the mid-point of the p-fch intei- 

^ I have obtained cxpiossiona for tho variation in tho atiindard dcviotion of Y 
and in tho coriciation coeflicicnt r botivcon X and Y, but liavo not moludcd theao 
m tins articlo. Tlioy will bo made available later in my Doctor's thesis 
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val of Z’e is callod the a, array of K’s. Similarly is the midpoint 
of the -i-th interval of F’s. Of the N paira of X and Y, iip will have 
the value of the X charactci in the interval Zp which foim the Xp array 
of y’s. This array will have its mean and its standard deviation, 
which we will denote by yp and <rp icspectively. The mean of all F 
charaoterB will be fj and their variability will be given by <rj. The 
number of the N items falling into the square with center y,) will 
be denoted by n„i. 

Let 6 denote the sampling deviation of a variate from its true value. 
Then since the distribution of X'a is oonetant from sample to sample, 
it follows that the deviation Sn^ is aero. We shall make uso of the 
propositions that if s and s' arc the frequencies in any two mutually 
exclusive non-independent (when either or both are subjected to 
landom sampling variation) frequency classes of a frequency dis- 
tribution of M elements the standaid deviation of s duo to landom 
sampling 18 given by 

S(i,*) - (1) 

and the correlation r„» between deviations in s and s' duo to random 
sampling is given by 

E[5s bs') = (2)‘ 

Now it is obvious that \vg may write 

Ny = Sp[S,inp{yi)] ( 3 ) 

where the sums are taken over all values of p and t. 

Taking the variation we have 

NSy = iSp[S,(«n.p{y,)l <4) 

squaring 

NW = (Sp[,S,(Snp,-y.)]}» 

- Spp>[S,{Snp,y,)S,{b7ip'iyp)] (5) 

where Sppi denotes the summation over all values of p and p' except 
for p = p'. 

Expanding again, 

N^byy = iSp[)Si,(3nV-yv*)] + »Sp[S,,(anpi4ap^,y,)] 

+ 5ppd^,{Snpj?np<,y,5)] -f iSpi/[/S„(67ip,5np»/2/.i/,)l (6) 

where the moaning of Si, is obvious. 


1 For proof, sco KioU, H I. ; " Mathomaljcal StatwlioB," 1027, p 119, 
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Summing and dividing by the number of possible samples of this 
kind, and using the pioposition that the expected value of a sura is 
equal to the sum of the expected values, we get 

EW - iSp[S,(E(dnj,r’‘)y.’‘)] + 'Sp[St,(E(Snp,dnp,)l/ii/,)] 

“H "h Spp>[St)(E(Snp^Snp'J)yiyf)J, (7) 

But from (1) it is evident that 

,Sp[S.(i5(5np,*)j/.*)l = ^!p|^S.(np.^l - j (g) 

and by (2) 

SplS.,(E(Snp.Snp,M} = -■Sp['S.,(^y2/, j. (9) 

Let us consider the expression E(5np,6np<,) for p different from p' 
Since Up is invariable from sample to aample, it follows that the devia- 
tion 5np, for any i within the group Hp cannot affect the deviation 
awp which is zeio and therefore cannot affect the deviation fiWp-, of the 
sub-group «p', in any other group np> for p different from p'. Hence 
the deviations Snpt, and Sfip', are independent for all values of p and 
p' provided p is different from p' 

Hence 

;E(5np<5np»/) = [E(Snp,) • ^(Siip-y)]. (10) 



Since we haVe assumed normal distiibution, and thus a homo- 
BcedasUc system with linear regression, all airays of 7'shnve the same 
standard deviation o-p-s/ 1 — r*. 

Then 


Spinpap^] = Nsy^ « - r^) 
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The standard error of the mean y is finally 


_ ^yi - 


( 13 ) 

which we note again is independent ot the dialribution ol if in tW 
sample. It must not be oonslrocd, however, that the expected value 
of the mean of the Y a is indopendont of the distribution ot the r« 
Istate, without giving proof heie, lhat Ihocipceled value otj is glvea 


y = yii + r'{i - a,) 


(U) 


where », and p* me the true means of the X’s and Ps for the emir, 
population and i 18 the moan ot the given distribution of X’e 
By Hmilar meUiods it is not diirioull to show that if all ot the 
items of a sample aie selected or matched on s - I chameters, where 
s eharacta ate normally diatabutod and not niilcpcndent, and with 

hnear multiple regression, then the standard ei.or of the means of the 
character X, ig given by ® 




•Vi - 


12 

Vn 


* Jl-t 


r" ' o'.r' ot Older . 
- 1 of Xg with the 5 - 1 vniiablos 

It may bo of mterest to Inuw that all ot the manlta contained m 
this paper have been eoniirracd independently through tlie application 

whi iTn^ ““'i somewhat moic rigorous method ot pioof 



RELIABILITY OF INTEGRATION INDEX 
DIFFERENCES 

JOHN W DICKEY 


State Noimal Scliooli Kcwaik, N J 

The formula 



(T 


( 1 ) 


has been picsentcd/ by the wntoi, as a quantitative measuie of pupil 
integration within the public schools The formula giving the relia- 
bility for separate indices has also been reported ^ 

The necessary compaiison of indices (whether made by the same 
population on different tests or on different forms of the same test, or 
made by uncorrclatcd populations on different tests or the same test) 
IS statistically impossible without the use of formulas which yield the 
reliability of their differences, 

It IS the purpose of this paper to derive the standard error and the 
probable enov formulas which arc nccessaiy in the comparison of 
indices for both the correlated and the uncoi related gioups 
Lo tj 

M\ = moan gioss acoie on teat one 
Mi = mean gross scoie on test two 
O' I — slandnid deviation of gros^ aroics on test one 
orj = stanchud deviation of giosa acoics on test two 
*= correlation ho tween test one and two 
N =53 the population 

Ml 

Ki ^ = lategiation Indc\ on te^fc ono 

O'! 

Mi 

Ki — - Integration Index on test two 

A = Ki — Ki - an index dilTeioneo 


The standard deviation oE siieh index differences, as 

(r2 0*1 

is the loquirod formula 


( 2 ) 


^ An Index of In tog i at lon. Journal of Bdiicalional Psycfiology, Vo\ XX, No 9, 
Dec , 1929, p 625 

* Note on the IlolmbiUty of tho Index of InCcgratioii Join ml of Edacaiwml 
Psychologij, Vol XXI, No 3, March, 1930, p 231 

200 



210 


The Journal of Educational Psj/chalogu 


By writing the total derivative of equation (2), we obtain 
difiercnfciftl equation 


dA 


(jidAfi — ATiddi 




2 


+ - 


AT idtfj 




the 


( 3 ) 


When squaring, summing and dividing by the theoretical infinite 
population, wo got the variance of A in tlic foini 

_ A'Pi<r\j — ^ u “b 0 

I- 


dk 


ds' 

-b 2( 


dr 


“ didyfii^ffUfl UM, -j- 0 -b 0 


di^ds^ 


( 4 ) 


The zeros in equation (d) occur beenuso the correlation botivecn 
the two independent variables, ilf and o, is aero. 

The following simplified formulas arc tho result wlien we substitute^ 

0-2 (fi , M 
J'v.M, “ > 12 , Vi “ »’b 2 ,«»-V « a\ « and K = yi 


in equation (4) and reduce to a convenient form. 

+^^2* - + 2)1 

whence 

d^K,~K,) - ;^vrr^*“r^2''“ v(/fi7f2>ip^ (5) 

and 

PE^K,~K,) = (6) 


In case the roliability of index differences (which occur when 
different forme of the satno test are used) is to bo substantiated, the 
correlation coefficient is at onco the reliability coefficient of the test. 

If the reliability of index diffei cnees (for uncorrelntcd groups) is 
to be investigated, formulas (5) and (6) reduce immediately to the 
formulas 




i j 2 + /ir,V 
V2V Nx Nt 


( 7 ) 


‘ Kelley, T.L,; "Statistioal Method,” New York Tho Maomilhin Company, 
1^23, p. 17R, foiinulfta US and 121. Tho iiBsimiptions, in tho cose of t,., = 
of reotiUneanty, homosoodosticity, and equal kurtosis, do not vitinto our findings 
eince a. ■variation of forty points in the coriolntiou cocilicient is icqmrcd ■toorwvto 
around a ton per cent error m formulas (6) and (6). 
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and 


PE 





2 -i- , 2 + 


( 8 ) 


where N\ aud Wa are the respective populations, 

romiulas (5) and (6) are used when indices are compared for any 
given population; whereas, formulas (7) and (8) are used when indices 
are compared for entirely different populations. 



PARENTAL AGE AND INTELLIGENCE OF OFFSPRING 

MINNIE LOUISE STECKEL 
Univerflit/ of Clucngo 


Tho objoct of this study was to diacloao, if possible, any relationship 
which might exist between tho intelligence of chilcU’en and parental 
ages at the time of tho birth of tho child on tlio basis of findings on a 
large population by the use of intelligence tests 

The data upon which this study is based woie obtained from 
public school children at Sioux City, Iowa and their parents during 
the school years 1926-1928. The study include.^ records of children 
from Grade I to Giado XII inclusivo Intelhgciicc ratings of the 
children weie obtained by means of group inlelligonco tests. Qucb- 
tionnaiies were sent to the parents asking for their own ages, and 
the ages and birth oidor of all tlicir childien. 

Four different group tests wcie used in Older adequately to cover 
the age range of mtolligoncc The KuhlmanmAndorson Test was 
used for grades I to Junior III; the National Intelligence Test for 
grades Sonioi III to Senior IV, tho Otis lulerinediate Test for giades 
Junior V to Senior VIII, and the Otis Advanced Test for grades 
Junior IX to Senior XII. Several thousand children were tested with 
each test It was possible, Ihercfoio, to rcstandardize on the same 
basis the intolligenco quotientB as obtained by each of tho four tests, 
BO that tho results of all four testa arc directly coitipaniblo. The 
standard scoic is calculated in the following manner 


o (IQ) - M 

<r 


m which S is the standard scoie, M is the mean intelli- 


gence quotient for the ycai gioup of the child’s age and o is tho standard 
deviation of the intelligence quotients for that age gioup By using 
the intelligence quotient upon which to base the calculations rather 
than the raw score, the measure is unccrielated with age By trans- 
muting tho mtelbgence quotients of each test into standard scoiea the 
possibility of diflferencos which might arise due to the relative diflioulty 
of the tests at tho various ago levels is eliminated The constant 5 00 
has been added to tho standaid scores as calculated in ordci to avoid 
negative values. Thus a child whose rating is 6 00 has an intelligence 
rating equal to tho average of all children of Sioux City of his age. A 
child with a score of 3.80 has a standard scoie of — 1.20 foi children of 
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his own nge group. Only records of normal children of the Caucasian 
race are included m this study, 

Some paients may have stated their own ages inconectly There 
was, however, nothing coinpulsoiy about answering the questionnaire, 
therefore these cases would be so few comparalivoly that they would 
scarcely affect the validity of the study. In Table I columns C and 
D show the distribution and mean intelligence of the children foi 
each two year age pei lod of the parents Figure 1 presents graphically 



Vw 1 , 

the lelationship between the mean intelligence of children born during 
each two year age period of the mothers Curve C shows this 
relationship for the first-born chilclien, and Curve D for all children 
regardless of birth-order. Both curves indicate that children born 
of motheiB who are less than approximately twenty-six to twenty-eight 
years of age are, in general, less intelligent than children bom of 
mothers who are this age or older. 

Curves A and B of Fig, 2 shows a similar relationship between 
intelligence of children and paternal ages. The chief difference is 
in the fact that the curves representing intelligence of children and 
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paternal agea indicate that chilcli’en born of fathers under approxi- 
mately thiity oi fchirty-two yoais of age nro in goneial less intelligent 
than children born at this paternal ago or older, whereas (as has been 
said) this period with lespect to maternal ages extends approximately 
only to the twenty-sixth to twenty-eighth year, 

C Although the curves indicate pcuods of very high intcUigence 
after twenty-eight and thiity-two yeais for the maternal and paternal 
ages respectively, these cases are at tho extrome of the curve and are 
represented by a relatively small number of cases. In general, after 
these age periods, there is a slight drop in the curves ropresentmg 
'Children's mtoUigonce. 



The curves C and A representing intelligence of first-bom children 
and parental ages are consistently higher than curves D and B repre- 
senting the intelligence of all children regardless of biith-ordor. 

These facta as presented might have several possible inteipretiv 
tions, It may be conjectured that whatever causes tho vitality of 
the human body to increase as maturity is approached and to diminish 
with advancing ago may also affect the uniting reproductive cells and 
have a deleterious effect upon tho mentality of tho offspring Anotlier 
possible interpretation may be that tho extiaordinaiy somatic diffi- 
culties accompanying child birth in immature and m elderly mothers 
might produce so great initial handicaps upon then children that 
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they may never be fully compensated by the time the children 
reach maturity 

It might be that the diffeiences in environmental factors for chil- 
dren of very young or elderly parents as compaied to those parents 
of the intervening age period are piotiounced enough to affect to an 
appreciable degicc the latmg of ohildron on an intelligence test given 
at school, 

Possibly the explanation of the results of this study is to be found 
largely on a nationality and socio-cconoimc basis. Grouping parents 
according to age necessarily involves nationality, and socio-economic 
groupings also. Although the data are limited to the Caucasian 
race, either one or both of approximately one-fourth of the parents of 
the children are foreign-born. These are largely of Russian, Lithuan- 
ian, and German extraction. There is a tendency for European stock 
to marry young. It also is probable that children of immigrants, 
on the whole, would i ate a little lower op an intelligence t est than would 
children of native-born parents. 

The army examinations showed that the various oocupabional 
groups draw men of different intelligence levels. Those occupational 
groups, therefoie, constitute social classes based on intelligence 
Studies by Hirsh,' Kornhausor,* and Haggerty and Nash,® show 
that the occupation of the father also is a fair index of the intelligence 
of his children, i.e., that there is a very real association between 
parental occupation and intelligence of offspring. 

Children of very young paienta aio children of parents whose 
occupational choice does not demand college or professional tiainmg. 
Many of these parents do not even go to high school. They drop 
out of school as soon as attendance laws permit or as soon as labor 
laws permit them to work. Not that going to college on the pait of 
the parents appreciably increases the intelligence of their offspring 
but the parents in occupations which do not demand a long period 
of training are of a stratum of society which hvea on a lowei economic 
basis. The more intelligent children are offspring of parents who 
have gone to college and professional schools. These parents of 

^ A Study of Nntio-raciai Montal Differences. Oeiielic Psychology Monograph, 
1020, pp. 230-407 

^Tho Economic Standing of Parents and tlio Intelligence of Their Children 
Journal Educational Psychology, Vo\ LX, 1018 

’ Mental Capacity of CiuUlron and Parental Occupation Journal Educational 
Psychology, 1024, pp 660-672 
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necessity many later. Their cliildicn are not more intelligent because 
the parents are older and possibly not because their parents have 
had more education but rather because their parents come from a 
higher, more intellectual stratum of aoelcty The scale of living of 
this stratum of society demands that mainngo and rcpioduotion be 
delayed until the parents arc economically able to maintain thoir 
family on a scale of living to which they themselves liavo been 
accustomed. 

The explanation of the fact that the intelligence of the child cor- 
relates as closely with the father’s age as with the mothox’s ago (except 
that the period of gieatcsl mtelligence for the child comes tlueo or 
four yeais later for tho father's age) might also be explained on a 
socio-economic basis rather than on a hoiedilary or biological basis 
accounted for in the fact of the later maturing of the male parent. 
The demand made on the father in support of his family delays his 
marriage and his reproductive period several years lalei than the 
mother's in order that ho may first establish himself economically 
and socially. Tlxat there is the same relationship between intelligence 
of children and paternal ngos ns between Inlolligenco of children 
and maternal ages might be explained in the fact that tho paternal 
ages correlate positively with tho maternal agea and tUcreforo bear 
a similar lolalionshlp to the inlBlIigoncc of then offspring, 

The seemingly greater intelligence of first-born childicn, as indi- 
cated by the highei curves A and C, undoubtedly has its explanation 
on a socio-economic basis. It is generally understood that tho lower 
economic classes have larger families than do tho professional classes. 
Tho children coming from the lower occupational gioups also have 
lower intelligence ratings As long as wo consider only the mtolli- 
gence of the first-born ohildron, each family la repreaentod only once. 
The superior intelligence of tho children of tho professional classes 
raises tho intelhgonce level of the entne group. In curves B and D, 
representing the intelligence of all children against parental ago, the 
relatively lower intelligence of the gieater number of childien from 
families of lower socio-economic groups lowers the mean intelligence 
of the entire group. Tho greater intelligence of childien represented 
in curves A and C la to be explained, then, not in the fact that they 
ate first-born children but in tho fact that each family of the lower 
occupational classes lias no more lopresentativcs in tho group than 
each family of the professional classes. 
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If late man:ago and reproduotion accompany a rising economic 
status, then the children of elderly parents should exceed the children 
of nudcHe-agcd parents in mtolUgenee A. slight diop of the mtelh- 
gonce curve of ohildien of eldcily parents might conceivably be due 
to biological factoia such as poor productive stock with a low fecundity- 
fertihly ratio or to the physical decline of tho older parent, The 
seemingly lower intelligence of chlldien of this group, as indicated by 
the leaults of this study, might also find its lutorpr elation on a aocio- 
economie basis; for not only do parents of Iho lower economic classes 
icproduco at an earlier age than do tho professional classes but there 
js a tendency for child-bearing to be continued throughout the entno 
reproductive peiiod of tho molhor of the laboring classes while for 
tho professional dosses child bcaiing is restiicted toward the close of 
the lepioductivc pcuod ns well as at its beginning. A slight decrease 
in intelligence of children of oldorly parents, as indicated in the study, 
might bo accounted foi in the fact that this part of the curve again 
ropicsents a pi epondcrance of children from the lower occupational 
groups. Undoubtedly this diop in the curve of intelligence would 
bo more pionounccd weio it not for the fact that within the same 
family intelligence increases with ordinal number as shown in an earlier 
study ‘ 

The relationship between parental ages and inlelligenoa of their 
children as indicated by the reaults of this study is doubtless a true 
relationship. Tho conclusion that tbero is a duect causal lelation- 
ship between parental ages and the intolligonee of their childien is 
not at all justified by the lesulls of the present study. Tho writer 
makes no claim to having established tho cause or causes underlying 
the lesults of the study 

If the population in question were first classified into oconpational 
groups and the ago of paienls and intelligence of children compared, 
any differentiation might indicate biological factors operating which 
are dependent upon parental ago. Picsent indications are that in 
such occupational groups the vaiiatioii in intelligence of the cliildien 
would be no gieatci than the occupational variation of the fiaienta 
within each group 

A subject closely associated with parental age and mtelhgenoo 
of offspring is amount of disparity between the ages of tho two parents 
as compared to the intelligence of thcii offspring Custom and general 

‘Steeled, Minnie Louise; Intolligonee and Birth Order in Family Journal 
of Social Psychology, August, 1030 
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opinion piesumably would favor ihe father being fiom two to five 
years oldei than the mother. In Table I, columns E and F give the 
distribution and mean intelligence of the children for each two years 
disparity botwecc the ages of the two parents. This lelationship is 
shown graphically in Eig. 3 Curve E icpiesents the mean intelligence 
of first-born children and curve E represents the mtelligenee of all 
children against the disparity between parental ages The disparity 
between the ages of the two paicnts is indicated by the ^‘Fathers’ age 
Minus the Motlier's ago.” When the father is the older paient the 
difference between the ages is indicated ae +, when the mother is 



older the difference is indicated as — ; and 0, of course, indicates that 
both parents aie of the same age. Considering both curves E and 
F, the mean intelligence of the childicn dccieases as the disparity 
between the parental ages increases. The curves both show a more 
rapid decrease m the intelligence of the children when the mother 
is the older parent than when the father is older At the extremes, 
in both -t- and — directions, the cases are so few that the curve is 
very irregular However, the general tendency downward, indicating 
lower intelligence, is quite ap paient. The curve of intelligence of 
the first-born children against disparity of parental age is higher 
than when the mtelhgenco of all children is represented. Heie again, 
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&3 with pai'cntstl age and intelligence, the lavgei families hnvmg more 
xepresontatives and lowci intelligence latings, lower the mean intelh- 
gence of the entire group. When the mean iniolligcnce of only the 
firat-born children is consideicd, the families of the professional 
classes have equal repjescntation with the lower occupational groups, 
so the mean intelligence of the gioup is higher 

The writer knows of no study imhcating whether gicatcr disparity 
between parental ages la more common betwoon foicign born parents 
or between native-born-pai orris, between parents of the professional 
classes or between pnronla of the lower socio-economic groups, or in 
which gioups the mother inoic often is the older. Such evidence and 
an occupational classification is neccssaiy before the causes which 
are operative to produce the iclatronship between intelligence of 
child and amount of disparity between paiental ages can bedeteimined. 

The results of this part of the atiuly indicate that the gveater the 
disparity between parental ages the less favoiablc i.s the piognosis 
for the inlelhgonce of the offspiing The prognoai.s, however, is more 
favorable if the fathei is the older paierit than if the mother is the older 
patent if the amount of disparity between the ages of the two parents 
la greater than four or five yeans 

Conclusions 

In general, as shown by intelligence tests, children born of very 
young parents are less intelligent than children born of more mature 
patents Below the ago of twonty-six to twenty-eight for mothers 
and thirty to thirty-two years for fathers, the younger the parents 
the less favoiable is the piognosis for the intelligence of the offspring, 
The present study indicates that the nearer the ages of the two 
parents approach each other the more favorable is the prognosis for 
the intelligence of their childien. The prognosis for the intelligence 
of the children is less favorable as the disparity between paiental 
ages grows extreme When extreme disparity exists between paiental 
ages the prognosis foi the intelligence of the child i.s better if the father 
18 the older parent than if the mother is the older parent 

The writer presents several possible interpretations of the icsulla 
of the study but makes no claim to having established the factors 
which might be operative in pioduciiig the resulta as presented. Fui- 
ther study must be made to reveal which interpretation most nearly 
approaches the truth. 



SEX DIFFERENCES- COLLECTING INTERESTS 

PAUL A. WITTY 
Northweatcra Univoreity 

‘ AND 

HARVEY C. LEHMAN 
Ohio Univoraity 

In a previous article the wiilors have questioned the instinctiveness 
of the collecting tend'ency.^ They have mentioned also some of the 
difficulties that one encounters when he attempts to define the term 
"collecting.” Definition of "collecting” appears to be varied and 
inconsistent; it is nevertheless true that studies of the articles which 
children report that they actively collect may reveal certain intrinsic 
interests of children. Therefore, it seems logical that such interests 
might be used profitably in motivating school work. Collecting inter- 
ests appear to bo associated intimately with the growing self ; the recog- 
nized identity of the interest and the gi owing self (with consequent 
inner urge) should piovide a genuine actuator of interest and conse- 
quent success m school work. Of course, numerous interests are 
undesirable; these should be recognized, sublimated, and redirected. 
Others, howevei, seem salutary manifestations of growth These 
should have abundant opportunity for expicssion. in the curricular 
activities Genetic studies of behavior manifestations seem to the 
wiiteis to bo of mestiinable value m guiding and developing school 
children 

In a pievious article, ^ the writers presented a list of approximately 
200 articles which children listed as ones they were actively collecting 
in 1927-1928 Further analysis of these data has yielded certain indi- 
cations of sex differences in collecting interests which appear to be 
significant 

As a means of studying the sex differences in collecting interests, 
the writers listed the articles* that were collected more than twice as 
commonly by boys as by girls, they listed also the articles that were 
collected moie than twice as frequently by girls as by boys By this 

* These data wore assembled by one of the wiiters and several gradualo stu- 
dents The table containing thoaiticlcsmoatficquently collected, and themetliod 
of investigation may be obtained by reference to this Journal, Vol XXI, 1930, 
pp 112-128 


221 



222 


The Journal of Educational Psychology 


moans two lists wove obtained. The first list therefore inoludes only 
those collections which seem to appeal picclommantly to girls; the sec- 
ond list includes only those collections which appeal strongly to boys. 

The articles which are collected much more frequently by girls 
than by boys appear in Tabic I, those which have a much moie intense 
appeal to boys than to girls are listed in Table II. 

In Table I, the articles collected by the girls are classified under 
seven headings, namely; (a) Objects possessing icsthetio appeal or 
value, (6) objects for poiaonal adornment, (c) objects of scntuncntal 
appeal, (d) dolls, doll clothes, etc , (e) household accoutrements, (/) 
Bouvenhs (piedominantly from the classroom), and (g) objects used 
in playing games. In Table II, the articles of unusual mtorcat to the 
boys arc assembled under six headings, namely: (a) Animal parts and 
insects, (6) junk (to scU), (c) tobacco souvenirs, (d) objects associated 
with war, hunting, fishing, etc , (e) objects used in playing games, and 
(/) miscellaneous ones. 

In examining Tables I and II certain facts should be kept m mind, 
In the first place one should recall that this presentation seeks to place 
in sharp relief sea: differences, not sex likenesses. If this fact bo over- 
looked, the render might exaggerate tho significance of the sex 
differences. For example, m Table I (a), tho girls arc shown to have 
collected more often than tho boys objects of aiathctic appeal or value. 
Nevevtheleas, one or moie boys collected all but one of tho items listed 
in part (a) of Table I. The items listed m Table I (a) aio not ai tides 
collected only by gills; they aie items which wore collected more than 
twice as frequently by girls as by boys. * 

One must bear m mind also that these data were obtained within a 
rather restricted geographical area. A specific environmental back- 
ground is therefore reflected. For example, in Table II (a) it will bo 
found that the boys collected furs, rabbits’ cnis, gopher skins, etc It 
IS clear that city boys’ collections would yield no such colleotious. For 
this reason the sex differences herein reported should be interpreted 
with the realization that they obtain for a specific locality only 
Nevertheless, when these data are viewed fiom the standpoint of tho 
several groupings rather than from tho standpoint of specific items, it 
seems probable that the sex diffcicnccs may bo representative of 
widespread and rather general tendencies. 

♦ TKq writers have prc-vio«sly discuBsed the tuct of box difTeroacca in ojstliotio 
appreomUan. (Sea itiiiertcan Journal of Peychology, Vol XL, July, 1928, pp 
449-467.) The pieseiit findings corroborato tho concluaionB sot forth previously. 
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Table I — Items Muon Mona Often Collected bt Gihls mam dt Boys 


808 girls, 
POT Msnt 


808 boyfli 

pDT cent 


(a) ObJootB poeaceBing ccatholia value or appeal, 

Foma 

FIowctb, prGBsed , . 

Flowers, pnpof , < < 

Groea (kmda oO * , 

LoavoB {kinda of) , 

MouogramB 

Moss (kinds o/) . 

Fiiper, colored 

Taper, tiBflue « < 

Fioluros . p 

Fooma (ool looted) 

ItosQ pcfcals 

Hooka (Wnda of) , 

Samples (perfume, etc ) , 

Piooes of calico 
HandkorohlefB , 

Sachet bags , 

(b) Objooto for poraonal adoromont 

Beads , a 

Bracolots 

Brenatpinfl 

Ear rings , i 

Jewelry • * * 

iato ♦ * * . 

Hatpins 

flenrf pina , , , 

Stick pina « « 

Binge , , ^ 

(c) Objeota which posecas sontl mental vnluo 

Autographs ■ p 

AMto graph scotuncnlB , , 

f^ong Books (kinda of) < • 

OaruB (oleoiioti, mont) , 

Leltera 

HBWBpnptT SornpB 

Programs (daiicQ, ofco) * 

Souvenirs , , 

Yolontines , , , 

Charm atringa 
Clovcfi four-leaf 

(d) Dolls ana doll paraphropatln 

Polls , « I « > 

Dolls of paper 
Doll buggies 
Doll clofcnea , , 

Doll diflhcB 
Doll liatB , 

Doll quilts 

e) Houachold nocoutrernenta 
China (painted) 

Diflhca (broken) > 

Napkins * 

Pieces of quilts. 

Spoons, , 

Thread , , 

, Strings 

Galondare 
Shoes (old ones) 

(/) Souvcnira froin the aolioolroom 
Schoolbooks 
Composibionfl , , 

Dranfiiiga 

(o) Objeota used In playing gamea 
JAckstoncs » * 
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Taulsj II — ^Itkms Much Mohb Oft'kn Collected hy Boys than by Guilb 


«Qfiboya, fiaagnls 

por renb pur cent' 


(a) Animal pnrU and ingGota 
Booties 
Snnilfi 

Spidrra * 

Bjrda 

Birds beaka nnd clavie 

]Iir(lH winga p 

Puts 

Goplirr flkina 

lUtthit caw 1 

flkclotone * 

Pkiniv 

ib) Juitk La Bcll (at least onlnblc) 
liontfi 
Bottles 
Brn&g 
Iron 
Jugs 

IIorsQ bIiocs 
Lead 

Metals (kinds of) 

Bubbor 

Till 

(c) Tobacco sou vein rfl 
Cigar hoklors 
Cigar Lngs 
Cigar tins 
Cigar stamps 
CiRcir pckporfl 
Tobnero sacks 
Tobacco tftttfl 

(rf) Objoata assoemted with war, bunting, flahmg, etc 
At tow beads 
Ibillots or cartridges 
Fish books 
I'hiil , 

Guna (toy) 

Knivoa 

Wampum 
War Tolica 

(^) Objodts need in playing gnmee. 

‘Marbles 

Marbles (ago to) . 

Tops 

Kites 

(y) Miacollniioous objects 
BadRca 
Books, story 
MatoliGs 
Nails 

Nfickllos , 

Oil cans 
Fadtockfi 
Pnnt guards, 

Rvibbor abcels 
Sacks (^kjnds of) 

Tprb, flipping 
Tags, tin 
Trado irmrka 

' Wftgoii >\]i{jola 


Sex Diff&ences 


226 


Table I (6) presents the names of objects which are used by girls for 
self-adornnient. Although most of those ai tides were collected to a 
linnled degree by boys as well as by giils, they were collected with 
strikingly greatei fiequency by girls I’m thei more, only one similar 
object (necktie) appears m the boys’ list Noticeable indeed is the 
fact that Table I (b) contains ten items In the conspicuous interest 
of the girls m this type of collecting and the paucity of interest among 
boys theie is evidence of one clearly defined sex difference m behavior 
tiend 

It is apparent readily that this attempt at classification is arbitrary 
and theieforo somewhat inaccurate. For example, m Table I (c) aid 
listed the names of objects which possess sentimental value. It is 
obvious that almost any cherished possession may have a sentimental 
value It is equally true that piactically any of the items listed m 
Table I may have been a gift oi a token, and therefore may have 
acquired sentimental value. Novortholess, if ono inspects carefully the 
two lists, he will grant undoubtedly that the girls’ list contains many 
more objects than the boys’ which generally arouse afiective reaction 
and sentiment.’” 

Table I (d) sets forth certain items that are collected almost 
exclusively by girls, namely, dolls, doll clothing, etc This sex dif- 
ference would scarcely be considered phenomenal This list however 
considered with hat I (c) brings to light conspicuous and apparently 
general Intel ests of girls 

From Table I (/), it will be noted that the girls collect souvenirs of 
the schoolroom much more commonly than do boys. No items of a 
similar nature appear in the boys’ list. (See Table II.) 

In the several lists presented m Table I (a) to (/), striking behavior 
patterns of girla appear. Girls are attracted by objects which may 
be used for personal adoinment; they assemble and appear to cherish 
much more than boys objects which call forth affection and sentiment; 
and they collect and keep lelics and portable objects which have been 
associated with school life The latter tendency may be additional 


* It laoF interest that the only items of the entiicone hundiecl ninety that suggeat 
iiupcrstitiouB belief, namely, ohaim sliiugs, anti foiii-lent cloveis, 'vvoie ropoited 
more often by tho girla than by the boys Sox chffeicnccs in thia logni d have boon 
reported by tho wiiters in a pievioua article (See Journal of Ahnounal and 
Soaal Psychology, Vol XXIII, 1028, pp 3B8-308 ) 
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evidence of the girls' rathci intense liking for school. This likmg m 
less freriuently found m tJie normal hoy * 

The objects collccled by the boya suggest, their out door activity 
and rather vigorous play life This is particularly striking in the 
fiisfc five claasificftlions of Table II I’eriisal of this table shows that 
voiy few of the objects may be described as ones winch possess aes- 
thetic 01 sentimental appeal. And the lists contain few objects which 
could be used for personal ndornment Fciv of the girls collected 
objects which, by any breadth of imagination, could bo made to fit 
into the first four classifications of Table II, The things collected by 
the girls reflect the relatively naiiow geographical radius which chavao- 
teiizes then lives The boys’ lists, howevci, reveal their relatively 
gieat participation in activities -which require a wide geographical 
sphere and iiniestrictcd outdoor activity. 

The rather striking sc\ diffcioiiccs found in Tables I and 11 seem 
to the writers to explain pnitially a finding reported by Miss Burk 
more than IhiiLy years ago. Mias Burk reported: 

The boys exceed the girls somewhat in fiiiding and hunting, and constdornbly 
in trading and buying The girls exceed the boys vci v greatly as passive recipients 
of outside assistance, in having thoir things given to them by brothers, sisters, 
parents, uncles, aunts and fiionds, Put this excess of passivity on then pait is 
not balanced by any special deoicnflo in the method of (hiding, hut it rather bal- 
anocB tho excess of tiadmg, buying, and winning iiniong tbo boys* (p, 104) 

The preceding comment is corroborated by Miss Whitloy. 

Tho porccnlnge of gnls depending on gifts to add to their collections is higher 
at all ages than it is for boys, and consistently lowci for tinding^ (p 250) 

The items listed in Tables I and II are not easily classifiable 
according to the “reasons” which prompted the childicn to collect 
them, Neveitheless, careful examination of the lists enables the 
reader to identify certain of tho leosons for tlio sex' difference in 
methods employed in making collections In the girls’ list the objects 
which possess sentimental value (Sec Table I (c)) aio ones which 
possess also little or no practical utility. This statement is true 
regarding most of the items in the other lists, I (a) to (/) Many of 
tho items possessing scsthctic and sentlmentnl appeal arc so perish- 
able that they have little or no value for trading or selling. Girls 

*ThiB also IS inchoative of n sox difforonco in attitude Hint tho wiiteis have 
picviously disousaed (Seo Edwalwn, Vol, XLIX, 1029, pp. 440-468 ) 
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appear to obtain many of their collcctioue as gifts and boys actively 
assemble collections m order that sale or trade may ensue, 

Of course it is true that many objects collected by the boys aie of 
little actual value or utility. But there is this sti iking difference 
between the giils’ and the boys' lists. All ton of tlie items listed in 
Table 11 (6) have a maikct valuo* and many of them have little 
value other than this The girls' objects of personal adornment 
probably have some market value, but this value is no doubt usually 
outweighed by the affeotive appeal of the articles. 

There is one other aspect of this point which is worthy of mention. 
It will be noted that the writers found it necessary to include a “miscel- 
laneous" grouping for tho items collected chiefly by boys. The 
girls' collections were more easily classified than were the boys’ 
This was due doubtless m part to tho greater variety of objects col- 
lected by the boys. The great variability of this type of behavior 
among boys is due m part to their relatively great freedom to take 
part in outdoor life (as compared with girls) and their relatively 
vigorous, unrestricted play life. 

Because they have pockets m which they can carry about more 
easily than girls certain of the miecellaneous objects collected by them, 
the boys are clearly in a bettor position than girls to satisfy whatever 
desire they may have to trade objects which they have collected. 
This desire is also more easily met by the boys because of the fact that 
in their spontaneous play life they traverse a wider geographical 
area than do girls. This fact has been pieviously commented upon 
by the writers^ (p. 93). 

Although the above attempts to explain tho sex differences in 
“method of and reason for collecting" are of interest, it is the judg- 
ment of the writeis that such theorizing has less value than knowledge 
of the actually observed tendencies of children If one accept the 
view that education is a matter of experience, that the curriculum 
itself 18 a series of experiences, it becomes at once evident that the 
boys and girls herein studied are not leceivmg the same sort of educa- 
tion. The pupils have themselves assisted in making their curricular 
differentiation, perhaps on the basis of genuine and deep interests. 
In any event, before the educator will be m a position to direct most 
effectively the child's education, he should acquaint himself with the 
child’s actual experiences 

* Tins 13 to be interpieted in terms of tho juvenile nntuio of boys’ trading nnd. 
soiling 
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errors, difficulty, resourcefulness, and 

SPEED IN THE LEARNING OF BRIGHT AND 
DULL CI-mDREN 

PRANK T WILSON 
^tatG Teacheis CoUegei BufTalo 

In a previous atudy‘ the learning of bnglit and dull children, was 
compared in a task of Icauung how to win a game in which two players 
alternately draw either one or two fiom a given number of pieces 
with the object of winning the last piece. Success requires the appli- 
cation of the piinciplo that one’s opponent must be forced to draw 
fiom a multiple of three at each of his plays It appeared in that 
study that for groups of childien nine and twelve years of age, half 
of each group at a level of 70 to 80 IQ and half at 110 to 120, the 
average difference of 30 IQ points gave advantage as measured by 
amount of work, to the brighter children, and that the average differ- 
ence of three years favored the older groups The difference in IQ 
seemed to be a little more important than that m chronological age 
since, as measured in the study, the blight nine eventually somewhat 
surpassed the accomplishment of the dull twelve who averaged 
practically the same mental age, 

I. Explanation op the Study 

This report gives the result of further study of the groups in this 
task in regard to the “Lost moves,” or errors made. Data for the 
groups are given m Table I, six additional cases having been included 
in the later study 


Tabdu I — Number of Cases 



1 Nine years ' 

Thvelvo years 


Dull 

Bright 

Dull 

Bright 

1 Total 

Boys 

8 ' 

8 

11 

7 

U 

Girls 

7 

10 

7 

8 

32 

Total . 

16 

IS 

18 

16 

06 

1 


^ Wilson, Frank Thompson ‘'Learning of Biiglit and Dull Children ” Bureau 
of Pubhoations, Tenclieis College, N Y, 
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Tho following explanation will make the references to the procedure 
of the task intelligible to the render. Complete explanations will 
be found on pages 12-16 of the first study 

“Paper clips were used for the pieces. Each subject had thirty 
trials each day. A trial was considered to be the senes of 'draws 
involved in the reduction of any initial number (of clips) to 0, regard- 
less of whether S (the subject) wins or loses.’ Petcison, J. C,; Tho 
Higher Mental Pi ocessea in Learning. Psychological M onog? apha, Yo\. 
XXVIII, No. 7, 1920, p 3.“i 

Tho learning was earned on for five succossivo days. The game 
was explained and ilhistratcd to tho aiibjocts with three clips. Tho 
task was begun with four clips and each subject, after having won 
once with four clips, was told that he must win three times m succes- 
sion, the lulo which constilutcd the cntciioii of successful learning 
of each step, The game continued with the four clips. Having won 
three times in succession with four tho task conlinued in tho same 
manner with 6, 7, 8, 10, 11, 13, 14, IG, and 17 clips, or as far as tho 
subject worked in tho one liundrcd fifty trials of the senes. The 
experimenter was the opponent of the suliject, and liis draws wore 
always so made that tho subject would win if drawing correctly but 
lose if drawing incorrectly That is to say, tho subject could always 
win if he applied tho principle. As far as practicable all other factors 
in the experiment were kept constant so that tho records show in the 
main, it is behoved, differences due to tho differences in the subjects 
of the four gioups. 


II. Total Lost Moves 


Table II — Averaub Ndmdbr or Losino Moves 



Nino years 

1 

TavoIvo years 

Dull 

1 

Bright 1 

Dull 

1 Blight 

Boys , . . 


81 

82 1 

1 

59 

Girls 


M 

70 

79 

Total 


82 7 

80 0 ' 

09 7 


Table II gives tho average number of losing moves for each group 
and for boys and girls. There seems little question but that the hi ight 
• Iiid„ P. 12. 
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twelve year old group has the best record and the dull nine the poorest. 
The slight numeiical difference between dull twelve and bright nine 
gives no grounds for deducing n significant real difference 

Differences between groups by sexes as shown m these data are 
uncertain because of the small number of cases for the sexes, but the 
comparisons are given ns they indicate the desirability of fuither 
investigation. The most striking comparison is that of the bright 
end dull twelve year old girls, who made practically the same showing. 
The dull nine year old girls did nearly as well as the bright nine year 
old girls. In the case of the boys the diffeiences are decided between 
the bright and dull gioups at each ago, while the two groups of the 
same mental ago score the same. Comparing sexes it seems that for 
the bright twelve group the boys did very much better than the girls. 
In the other thieo groups the differences are probably so small as to 
be statistically valueless. 

Conclusion 1. — From the straight count of losing moves made it 
seems that success in the task is moie probable for the bright older 
subjects and that mental ago is the most significant factor. 

Ill Same Lost Moves 

There was made next an investigation of successive same losing 
moves. Does the presence of differences in IQ and real age produce 
records for successive same losing moves which compare groups 
otherwise than do the recoids of total errors? Table III gives the 
data for the groups by sexes. 


Table IIIA — Avebagb Number of Times Same Losing Moves Webb Made 
Two OR More Times in Svcobssion 



Nine years 

Twelve years 

Dull 1 

1 

Bright 

Dull 

Bright 

Boys 

U,8 

7 6 

10 3 

6 3 

Girls 


10 7 

9 9 

10 8 

Total 


g 3 

10 1 

1 


The figures should be read as follows. The average dull nine year 
old boy made the same losing move twice or oftener in succession, 14,8 
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times m his one hundred fifty driiws, Ihc average briglil nine year 
old boy 7 5 Iutigh; etc. 

Something new seems to be present in this table The bright nine 
year old boys score better than tlic dull twelve year old and the diffor- 
ence is laigc. In fact the bright nmo luo nearer the bright twelve 
than they arc to the dull twelve. The girls, again, however, make 
records nearly the same, except the dull nine wlio aie much poorer 
than the other girls. Tlicir superiority over dull nine boys is not 
sufficiently ceitnin to move than note, 

Tho significance of making the same losing move successively 
is not wliolly deal Questioning of subjects afloi experimentation 
brought out the information that sometimes the same moves were 
mado in order to study them move carefully to discover other possibili- 
ties. Such a process may have been inoio ficquent with tho bught 
Obaorvatioii and introspection suggest that soinctinics the same moves 
wore mado bcoauso tho previous tiial was not lemcinbcicd correctly 
and the subject thought he was playing difforciitly the second time, 
Such procGssoB may have been more common with the dull. Table 
IIIB, although covering very few cases, ciuphftSiKcs the weakness of 
tho dull nine in repeating the same losing moves many times, 


Tabi,b IIIB — Avebaob Nombeji op Times Samd Losinci Moyhs Wjjub Made 
IN 3 to 9 SucoisssiVBi TniABS 



Dull 0 1 

j Blight 0 

Dull 12 

Bright 12 

Samo movoa' 

Tlireo bimcg 

1 B 

1 4 

0 

1 0 

Four times 

l.l 

X 

.3 

3 

Fivo times 

3 

0 

0 

0 

Eight times 



1 


Nmo times , , 

.1 





A complication in interpreting all tho data of this study exists in 
tho nature of the differences in the difficulty of tho successive stop.s of 
the task This is affected by tho practice which goes on with learning 
each stop as well os by the numboi" of clips used in the various steps, 
The subjects had varying amounts of practice on tho several steps 
dependin g upon how quickly each wod three times in succession. Some 
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subjects had much practice on the early steps because of failure to 
wn the tlnee times OLheia had Uttlc practice m the early steps 
because they did wm thiec limes with only few losses Yet the latter 
apparently doing bettoi with the problem at first often, found later 
steps just as difficult as those who hud raoro tioublo at first. For the 
blight, however, it .should be noted that, as they progicsscd farther 
than the dull of the same iigc, llioy lind to woik with steps using more 
clips and, nccordiugly, having moic possibilities in the way of moves 
With those larger ninnber.s of clips it seems that subjects intentionally 
repeated same moves in order to study the situation more thoroughly. 

Conclusion 2. — ^Analysis of successive same lost moves seems to 
indicate that biightnoss acts to reduce such onors 


IV. Difpiculti” op Steps 

The difficulty of the steps, which it has boon noted just above, is 
uncertain, has been studied from the data logardrag the number of 
lost moves by steps and gioupa. Tables IVA, IVB, IV C, and IVD 
show these data. 


Tailb IVA — Dippiculty op Steps by Groups Measured by the Average 
Number op Alb Ixisikg Moves 


Step 

4 

5 

7 j 

s 


11 

13 

1 

14 


17 

Dull 9 

2 0 

2 2 

32 7 

10 7 

31 3 

5 

1 6 

8 

.7 1 


Bright 9 

.0 

1 2 

0 3 

12 5 

30 li 

10.4 

4 3 1 

1.3 

8 


Dull 12. 

7 1 

1 

1 4 

7 0 

IG 8 

38 4 

11 0 

3 3 1 

.9 

1 3 

05 

Bright 12 

4 1 

6 

6 4 

8 6 

27 8 

11 0 

|84| 

2 0 

1 2 7 

1 A 


Table IVB — Difficulty op Steps by Groups Measured by the Average 
Number op Same Successive IjOSinq Moves 


Step ’ j 

4 

6 

1 

. 7 

8 

m 

11 

13 

14 

10 1 

1 

17 

1 

DulIO . , 1 

40 

33 1 

5 80 

2 40 

4 33 

OG 

.20 




Blight 9 , . 

11 



1 no' 

B 27 

1 22 

22 

11 

00 


Dull 12 

11 

11 ' 




1,26 


06 

OD 


Bright 12. 

.07 



1.27 


1 27 

.73 


13 
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Table IVD IS an hypolhclical record made up by converting the 
number of actual lost moves recorded foi cacli group into what those 
figuics hypothetically become if one liundred per cent of each group 
had been allowed enough Inals to solve each atop. The arithmetical 
sources for Table lYl^ are found in Tables IVA and IVC. Thoic is 


Tari^e IVG— Peuckntaop of Each Gkoup SoiiVmci tjiu Various Steps oi! 

Tiin Task 


Stop 

6 

7 j 

8 

10 

U 


u 

10 

17 

Dull 9 . . , 1 

1 100 1 

■1 


7 

7 

7 

7 

1 

1 





j 83 

U 

1 

17 

7 



Dull 12 



19 

67 

28 

11 

n 

1 

7 


Bugkt 12 . 



IlM 

80 

73 


27 


13 


Table IVD — ^Difpiout/cy op Steps by Guoups MEASOUBn by tub Avebaqs 
Number op Alu Losing Moves Cortiecikp pou One IIuNDniaD Per Cent 
Solving Each Step 


Step 

; ^ 


1 ^ 

s 1 

1 

to 1 

n 

' 13 

1 

DhHO . . 

2 D 

2 2 

1 40 0 

26,0 

417 

1 

1 

Bright 9 

0 

1 2 

6 3 

12.5 

1 

47 1 

37 0 

26 3 

Dull 12, 1 

.7 ' 

1 -1 

7 6 I 

15 8 i 

67 3 

1 

41 4 

30 

Bright 12 

A ' 

6 

0 i ' 

8 S ; 

34 8 

10 3 

21 0 


consideiablo probabdity that if ali subjects had been peimittcd to 
work until each step had been solved as far as shown m Table IVD the 
actual records would be differ ent ns the practice obtained at one step 
would affect the work on the following steps. But even granting such 
probability Table IVD doubtless represents the facts m regard to 
compaiative difficulty of steps more tuily than either of the raw data 
in Tables IVA and IVB. If objection is made to this assumption, 
however, the raw figuies may be referred to as the same relative dif- 
ferences and comparisonB of groups arc found in ibem, although not 
such striking ones The figures for the larger numbered steps have 
little significance because few subjects reached them It seems, then 
that attention is warranted chiefly to the first part of the series. 
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The dull nine gioup found stops four and five much more difficult 
than did the other groups Step seven became a much more difficult 
problem for all gioups than the picceding ones, but for the dull nine 
it appears to have been vciy much more chfTicult, only eighty per cent 
of the gioup ultimately solving it and the aveiage number of lost 
moves at that step being 33, or collected, 41, Step eight appears to 
have been easier for tho dull nine, at least after the practice they had 
had on the previous steps. There is a slight drop in the percentage 
which solved this step, but even so the corrected numbci of lost moves 
shows a smaller figure for step eight than for step seven For the other 
groups step eight seems to be harder than seven. The next step 
jumps the losing moves up to very much higher figures, and from the 
table of the percentage who solve step ten this one is Waterloo to the 
dull nine. Only seven per cent .survive its demands. The coriected 
average number of lost moves thereby becomes 447. There seems to 
be no doubt but that the difficulty of step ten, even after the previous 
practice of tho task , is vciy severe for all gioups. The next step, eleven, 
is not quite so hard for the remaining three groups, although it elimin- 
ates more than another one-third of the dull twelve For the three 
groups it IS harder than any previous step, excepting slop ten Pos- 
sibly the succeeding steps are easier. The small amount of data for 
them does not warrant conclusions and none are theiefore made. 

Conclusion 3 — Apparently all groups found step ten the hardest 
as it was met with in this sorica. Relatively it was very much the 
hardest for the dull nine. For all groups but dull nine, the preceding 
steps increased m difficulty and the succeeding steps decreased in 
difficulty For dull nine step seven presented an extremely acute 
difficulty and step eight considerably less difficulty than either step 
seven or step ten. 


V, Resourcefulness 

Whethei or not this term is the coirect one to use, the data given 
in Table V show in a comparative way to what extent the difterent 
groups used successive same losing moves and other losing moves The 
figures foi each group give the per cent that the moves at each step 
wore of the total number of the whole senes of steps. 

The table should be read as follows* The dull nine made three poi 
cent of its successive same losing moves at stop four; two pei cent at 
step five; etc It would seem that, if the proportion of successive 
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same losing moves was greater than that of the other losing moves at 
the beginning of the task and if the proportion decreased toward the 
latter end, it would be leasonable to hold that subjects weie aban- 
doning a method of little or no leturn for some other method of more 
piomlse. 

The figures in the table indicate a slight superiority of the bright 
gioups over the dull, especially if the per cents are totaled for steps 
four to ten Blight twelve, which made the best progress in solving 
the problem, 1ms a much better record than dull twelve and the bright 
nine show a better score than dull nine. 


TADLn V —Per Cent at Each Step That Same Losing Moves Ann op Total 
Same Losing Moves Compared with Per Cent at Each Step That All 
Other Losing Moves Are op Total All Other Losing Moves 






Steps 



Total steps 


4 

5 

7 

8 

10 

11 

13 

4-10 

Dulls 

■ 








Same losing moves < > « . 

Q 

2 

43 

18 

32 

* 


98 

Other losing moves 

■ 

3 

37 

20 

37 



100 

Brights* 

■ 








Same losing moves 

B 

1 

7 

17 

67 

13 

p 

83 

Other loamg moves 

1 

2 

8 

16 

47 

21 

1 

0 

73 

Dull 12' 






1 



Same losing moves 

1 

1 

10 

27 

44 

13 

6 

83 

Other losing moves 

y 

2 

10 

20 

60 

14 

4 

83 

Bright 12 









Same losing moves , 

1 

D 

12 

16 * 

47 

16 

8 

78 

Other losing moves. , 

1 

. 

y 

9 

12 

40 

18 

13 

63 


Conclusion 4. — In the kind of “legourcefulnesa” shown m Table 
V brightness seems to be significant 
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VI. Speed op Learning 

Tablb via — Avkragd Number op Total Losing Moves for Each Day 


Boys 


Total 

Dull 

Blight 

Dull 


Dull 

Bright 


Nmo YcRrs 


1 



12 0 

9 2 

29 3 

20 6 

2 



17.3 

16 4 

32 3 

30 8 

3 



16 6 

19 2 

33 4 

31.8 

4 


24 3 

20 7 

20 3 

43.3 

44 6 

6 


18 1 

21 3 

19 2 

41.3 

37 3 

Total , 

91 3 

80 6 

87 0 

84 3 

1 179 6 

166 0 


Twelve Years 


1 

10 3 

7 4 

9 3 

8 8 

10 6 

16 2 

2 

16.6 

11 1 

16 0 

16 3 

31 0 

26 4 

3 

18 7 

14 0 

18 1 

17 9 

36 8 

32 8 

4 

16 6 

13 1 

17 7 

17 6 

34 2 

30 6 

6 


12 1 

19 3 

19 0 

39 1 

32 0 

Total . t . ' 


68 7 

79.4 

79 3 

101 3 

138,0 


Table VIE — Averaos Number of Same Losing Moves Each Day 


Boys 

Girls 

Total 


I Bright 


Bright 1 

Dull 

j Bright 


Nine Ycais 


1 


■B 

3 0 


2 9 

1 2 

2 



, 2 8 


! 2 6 

1 G 

3 



2 9 


2 2 

2 1 

4 



2 6 


2 9 

2 6 

6 


■11 

3 3 


3 3 

1 9 

Total 

12 9 ! 

10 7 

14 8 

7 6 

13 8 

9 3 


Twelve Years 
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Table VIA gives the figures for the average number of total losing 
moves by sexes and groups for each daily set of thirty trials Table 
VIB gives the figures for the aveiage number of same losing moves by 
sexes and gioups for each daily set of thirty trials This arrangement 
of the data shoivs something as to the rate at which enois decreased 
or increased duiing the senes of one hundred fifty trials Using the 
bright twelve year old boys as suggestive of the most efficient learning 
it is found that in both tables that group increases its average number 
of eiiors through the second and third days and then progressively 
decreases the number for the fourth and fifth days. With more or 
less irregularity either the opposite takes place with all the other 
gioups, that IS each tends to increase its errois fiom day to day, or 
they fail to materially i educe the errors The bright nine year old 
boys offer the most irregularity, One is in doubt m legard to this 
group whether to believe the number of errors tends to Inciease 
throughout the first four days and then tends to decrease, or whether 
the apparent great difficulty of the fourth day really belongs to the 
third and fourth days and means that progress remains about the same 
after the second day. 

Conclusion 5 — ^Measured by frequency of errors it seems that 
brightness operates to decrease errors more quickly. 

SUMMAHY DisCITSSIONT 

Comparison of bright and dull children in certain noted reactions 
of the complex process of the task of this study shows for the groups 
of the experiment that on the whole the older and brighter children 
react more efficiently than the duller and younger. The noted differ- 
ences are not, however, certain differences in all cases The certainty 
seems best for bright twelve year old boys 

Two obseivations may be made m view of these findings Each 
has merit and the two lead to an hypothesis of importance. First, 
whatever real diffei cnees may exist between the foui gioups studied, 
each group and every last subject in each group, made appreciable 
progress along the same lines of effort. Dull and bright, young and 
old solved steps in the problem as measured by a piaciical, common- 
sense criterion of every day kind, namely: Repeated success in getting 
the desired result — ^in this case winning the last clip three times in 
succession at each step It took the dull and younger a little longei 
to advance from step to step, but by the same measure of success 
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they did advance several stops They made errors, to be sure, but 
the blighter and older ones also made errors and the same kind of 
errors Individually some of the brighter ones, also, made more 
errors and progressed moie slowly than some of the dull ones 

This observation of the general ability of the dull groups to pro- 
gress along the same linos as the brighter ones is an interesting ono 
to keep in nund in view of the often heard stnlcmciit that dull folks 
are not headed m the same direction as bright ones. 

The second observation offered is that pcihaps the gross nature of 
the measurements used in the records failed to reveal the importance of 
the differences really present Thieo illustrations of such apparently 
small but significant differences, are found m leputable mental tests. 
Gesell in his schedules for studying the mental growth of the pre- 
school child rates an infant who "unmistakably articulates” two 
words in addition to ma-ma oi da-da as a very high nine months old 
child; while five words, only thioo more, places him as very high at 
twelve months. That means that at this period of life just three 
moie words make a warrantablo addition of 33 per cent in estimated 
mental development In tho Stanford revision of the Binet test 
the exact lepetition of 12-13 syllables is given for the fourth year; the 
repetition of 16-18 syllables for the sixth year; 20-23 syllables for the 
tenth, 28 syllables for the sixteenth Thirty words in the vocabulary 
test place one at ton years; forty at twelve; fifty at fourteen , sixty-five 
at sixteen, and seventy-five at eighteen. The nature of tho task 
studied in this report may very well be so complex and demanding 
that the small differences recorded m the data really mean great 
differences in ability 

If this conclusion is tenable a following general conclusion is 
justified and, it seems, highly significant. It is, m words of the day, 
that the ability of the dull and young subjects in this complicated 
problem is not to be laughed at How far they have gone from the 
true zero point can not be said, but if the small recorded diffeience 
between their ability and that of tho bright is so much that it stands 
for a large real difference, then the differences between the arithmetical 
zero of these data and the points scored by the dull groups must stand 
for a truly groat amount of ability, certainly for so much that m it is 
promisQ^ not despaii 

Final Conclusion , — Dull nine and twelve year old boys and girls 
found the complex task of learning to win a game, success in which 
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depended upon the application of an underlying pimciple, more diffi. 
cult than did bright nine and twelve year old boys and girls, when 
their success was estimated in terms of fiequency and repetition of 
errois. The dull did pi ogress, howevei, and the bright children 
made the same kind of errois hut fewer of them. 
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SELF-CULTIVATION AND THE CREATIVE ACT: ISSUES 
AND CRITERIA^ 

HAROLD RUGG 

Tcncliors College, Columbia Uinvereity 
1 

No contribution of the child-centered schools is greater than the 
discovery of the principle that only an artist- teacher can discover 
and develop the artist in the child. Only one who has lived through 
the art experience can provide art expeiiencea for tho children; that is, 
one must himself have the attitude of a creative person in order to 
develop children into creative persona. This is the important generali- 
zation that emerges from the scores of creative artists m our now 
schools dunng the past fifteen years. 

But the cultured person is both pragmatist and artist, both a 
maker and door and a creative apprccialoi of life The complete 
educational program, theieforo, must embrace the attitudes, concepts 
and techniques of tho creative and appreciative individual as well as 
those of the problem-solver Now to develop the instrumental values 
and activities of life a monumental library has alieady been produced 
under the leadership of Mr Dewey. But of the criteria for the 
education of the Man-as-Arfcist little has been said. 

It was to the concepts of the artist that we turned in our attempt to 
sketch a balanced portrait of the integral peison. In him we perceived 
the guiding concept’ The integrity of one's own self , . one's authen- 

tic inner truth as the true criterion for judgment and for conduct . . 
admiration for every well-thought-out peisonal philosophy It is 
the Man-as-Aitisl who la sensitive to the criterion of integrity, who is 
dominated by the attitude of appreciative awareness The true 

* Chapter XIX of tho author’s foifchcoming bookj '^Culture and Education in 
America.’’ Harcourt, Brace and Company, New York (In press ) 
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craftsman is he who stresses Feeling-Import, who gives creative 
desire a place coordinate with intelligence He sees man whole and 
in turn visualizes the nation as a multitude of integral persons. Corre- 
sponding, it IS the artist in the school who is concerned with the 
pi od notion of persons, not piimniily with developing professional 
poets, painters, actors, thinkeis, or musicians. Hcnco the source for a 
psychology of the creative act lies in the experience and the vision of 
the artist himself 

In addition to possessing a sensitiveness to the noims nnd crilerm of 
the creative attitude there is another fundamental qualification for 
serving as the artisl-tcaeher That is, the sensitiveness to the potential 
artist in the child and his methods of work The development of 
creative education in the schools depends moic crucially upon the 
adoption of the “drawmg-oub” attitude by the tcacliei than it does 
upon his mastery of technical knowledge and skill in manipulating the 
materials of one art. The cioativc teacher has this attitude He 
regards every child as a potential aitist, each in his own modicum of 
creative powei, Hence, the artist is a sensitive hstonei to childhood 
As Miss Levin puts it: "You have lo feel the thing the child wants to 
do, to think his thought, m short, become a child yourself ” 

The educational conclusion from such postulates is clear In 
order that childicn shall become self-expicssivc craftsmen with 
woids or tone, with clay, wood oi stone, with light and shade, the 
teacher must be a craftsman with those mateiials. Thus, and only 
thus, can he become sensitive to the potential pei'son in the child 
This was the epoch-making message of Hughes Mearns. It was like- 
wise the stimulation given by Satis Coleman m her "creative music ” 
So the theme recurs with the materials of painting, sculpture, the 
dance, or the diama. Thiough each medium of selt-expiession 
children develop the ability to express themselves honestly, creatively, 
end to grow as persons only to the extent that the teaohei ’s attitude 
and procedures provide for them. 

Thus, the significance of the enhance of the artist into the school 
IS as great as his discovery of the aitist in the child It is through 
creative production m the school, in the homo, m every social agency 
that children receive piactice m developing the integral of one’s self 
They learn to measure themselves against ciitical inner standards 
Children must ask- Is this poem I have written leally "I”? Is this 
house I have made, this music I have played, utensil I have con- 
structed, brief I have prepared, oralion I have delivered, as close an 
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approximation of my true self as I can make it? This is the criterion 
which the artist ruthlessly applies to himaclf, and this is what he has 
contributed to the creative phases of the new education. 

Ho has recognized attitudes, points of view, and techniques which 
arc indispensable in the education of the cultured man Thus he 
an important con Inbulmn to general educaliou as well as to the 
development of potential artists. 


2 

The scientific attitude is analytic, and the method of work con- 
centrates upon the systematic collection of facts measuied on scales of 
equal units, the discovery of recuirences, uniformities, 

The artist's attitude, however, la integrating, all-embracmg, 
appreciative. The artist measures*^ but against the unique inner 
norms of his own peculiar experience, not against external standards. 
Correspondingly, his goal is nonuniformity, the unique individual 
thing Whereas science emphasized the adjustment of the individual 
to an external norm and seeks the confirmation of generalizations, art 
on the contrary shuns repetition and denies the possibility of confirma- 
tion or refutation 

These distinctions set the stage foi our study of the difference 
between the methods of work involved m three essential kinds 
of activity: (1) Intelligent problem-solving, (2) creative produc- 
tion, (3) appreciation Phrased another way, the question amounts 
to this* What are the likenesses and differences among these prooesses? 
Students of the creative act maintain that there is a difference between 
the process of problem-solving (in which assimilation plays the leading 
r61e) and that of creative self-expression and contemplative awareness. 
The instrumentalists deny this They maintain that the assimilative 
act and the creative act are merely differing aspects of the same 
general procedure of learning. Always protagonists of the unity of 
experience, they maintain that those who distinguish between assimi- 
lation^^ and '^cieation^' are resorting to a dualism Since the discus- 
sion throughout the book has emphasized the unified character of 
human experience, that oriticism does not apply in the present instance. 
The distinctions which aie nov^r to be pointed out are of another type 
At this point we must remind ourselves of the current tendency to 
apply the word ‘‘creative^' to any kind of active vigorous leaining. 
Such a tendency is conspicuously evident just now among educa- 
tionists Lectures by professors of education and others subsume 
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under the caption ‘^creative'' the most obvious kinds of repetitive 
leartmng, mastery of skills, and acquiring of information Nothing 
but confusion can come from such a careless use of meanings and 
vocabulary 

Next^ a woid concerning the data and the method of my analysis, 
The data are the subjective materials of experience^ and the method 
is that of introspection, or rather ictrospection Wc are studying the 
mental and emotional experience undergone in the creative act. It is, 
theiefore, only by the introspection of the cieahve artist that the 
experiential data of the process can be exploied. No person who 
has not experienced this process can generalize concerning it, and no 
objective measure of products can lay bare the process itself 

Hence my description of the creative process is based upon occa^ 
sional flashes obtained in the autobiographical liteiaturc of creative 
artis^^s and creative scientific men, fiom similar examples of intuitive 
understanding obtained in conversations with such persons and from 
my own introspectionsi (In earlier years I had prolonged contact 
with the processes of the scientific method both m physical and 
intellectual technology In recent years I have devoted considerable 
energy to the creative arts ) 

The techniques of introspection and retrospection must not be 
despised They are the only possible means of exploring '"processes^’ 
of learning. They arc indeed the techniques used by Professor Dewey 
m his famous analysis of ‘Hhe complete act of thought’’^ (that is, the 
complete act of problem-solving, foi Dewey is considering only one 
type of thought) The validity of that subjective analysis was 
established, of course, by the confirmation that came fiom the cumular 
tive, introspective analyses of other students of problem-solving- The 
validity of my present analysis of the creative pioccss must be estab- 
lished in the same way I am only too well aware of the difficulty 
which the creative artist encounters m giving utterance to the kaleido- 
scopio succession of his complex inner states^ Neveifcheless we must 
attempt the task and to do so we must put ourselves in the attitude 
of the artist Only so can we make a valid record of our expcnonccs 

Furtheimore, as I said before, no objective mcasuicment of 
products or of overt behavior will portiay the inner process itself 
That is clearly illustrated in the monumental work of Thorndike and 


* Dewoy, John '‘How We Think D C Heath and Company, New Yoik, 
1913, Chap, V 
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Judd in reading, and of Freeman in handwriting Thorndike ineas^ 
ured the product of reading; Judd and Freeman measured the overt 
signs of the processes themselves, that, is by the photogiaphy of eyc- 
inovements in reading, by hand and fingei movements in writing 
But even the latter did not iccord the experiences which produced the 
behavior of the product What they are can only be inferied and, 
indeed, only approximated by the caiefiil introspection of the person 
himself. 

3 


What, then, is our task? It is the analysis of thiee ways of 
knowing. Problem-solving, creating, and appreciating Let us begin 
with an analysis of the four aspects of the learning process, First, the 
attitude of orientation; second, the initiation of the act; third, the 
ongoing piocess itself, fourth, the definiteness with which the achieve- 
ment of the goals can be ascertained , that is, the possibility of confirma- 
tion or refutation. 

In analyzing these we shall postulate the imified natuie of experi- 
ence We shall conceive of each human response as an integration of 
physiology, intellect, and emotion. No dualistio separation of 
faculties or elements of response is implied in my discussion, On the 
contrary, it is assumed that the organism responds as a unit, and 
every act is conceived as a fusion of sensori-motor set (attitude), of 
meaning, of generalization, of language, gesture, and other overt 
movement. Life is a succession of infinitesimal expciiences, each a 
complex weld of the many kinds of process with, which the human 
organism has the capacity to respond The human act is not mosaic; 
it is fusion, 

Neveitheless, our argument is that all human acts are not alike 
For example, the tendency to flee from a situation is unlike the tend- 
ency to embiace it and we give different names to them, The 
emotion of anger is unlike the emotion of love and their descriptions 
vary accoidingly One act is oriented by one attitude, another by a 
very different one One makes much use of meaning and generaliza- 
tion, IS predominantly intellectual. Anoihei, howevci, is predomi- 
nantly motor response, calling into play but few intellectual elements. 
Still another may be hyper-sensoiy, involving little oveit movement 
but much internal kinesthetic response — a gathering- together piocess 
highly charged with emotion Thus the composition of human acts 
vanes greatly. Hence, in exploring the acts of problem-solving. 
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creating and appreciating we shall expect to find similarities and 
differences in Iheir constituent elements. 

4 

Consider, first, the attitudes oiienting the act of pioblem-solving. 
In confronting a problem, the worker is oriented outward. The 
conditions of the problem are “given Here are some examples; 
One has to find the distance between two points, to discover the 
combination of elements which make up an unknown; to design an 
engine of known-in-advnnco horse power, cylinders, and the like, 
to determine the most favoiable disliibution of practice required to 
produce a de.sired amount of skill, or to determine the dimensions of an 
I-beam which will withstand known-in-ndvnncc loads. 

In each of these “problems” the attitude is set in reference to 
external needs To grasp the pioblcm, the individual must adopt the 
attitude necessary to understand the conditions set by it. As Dewey 
has said, unless the individual can perform an indicated set of opera- 
tions, he cannot respond with its meaning, that is, unless he adopts 
the attitude appropriate to the problem he cannot understand it. 
This is the essence of the active psychology of meaning built up pri- 
marily through the efforts of Peirce, James and Dewey It^ is only 
by striking the attitude ligoiously deteimined by conditions outside 
his own experience, external to his backgiound of meaning and 
generalization, that the problem-solver successfully recognizes the 
“felt difficulty” in the “forked-road” situation. 

In the creative attitude, however, the onentation is inward 
It IS subjective, not objective, as m pioblcin-solvmg The creating 
process is piopelled by an inner urge to objectify moods, to portray 
overtly personal integrations of meaning, generalization, and emotion. 
The drive may be to write a poetic phrase or line oi stanza, to poitray 
something with pencil or brush, to put together a new combination 
of tones or bodily movements that will objectify a fusion of ideas 
and feeling But the attitude adopted in the initial stage in the 
creative act is determined by reference to the subjective, inner experi- 
ence of the individual 

There is also a second distinction, Wheieas the “problem” 
of the problem-solver is external to the individual, the “problem” 
of the artist is internal. There is a difference m definiteness. Prob- 
lem-solving is focussed with sharpness upon conditions prescribed 
m the external world, such as the loads, span, strength of materials, 
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etc involved in the design of the I-beam, the location of points Involved 
in the determination of distance, or the piescnbed horse power, 
numbei of cylinders, etc in the design of the engine The problem- 
solver must adjust with exactitude to these externally prescribed 
requirements 

Not so with the orienting attitude in the creative act It consists 
at first of little more than a vague lesllessnoss, an undefined desire 
to express m an oxternnl product the internal cxpciience of the individ- 
ual This gives us, indeed, an important cue to the difference between 
problem-solving and creating; that is, the unchanging rigor and 
clarity of definition of the externally-set problem anti the constantly 
changing indefinite character of the artist's subjective vision. 

Now compare the appreciative attitude with that of pioblem- 
splving and creating The first has resemblance to both the second 
and third, but it is much more like the creative attitude than that 
of problem-solving. What arc its elements? Although it is stimu- 
lated by external conditions, it is not really oriented externally. It 
IS oriented by the internal personal gathering-together of the self. 
In appreciating a lono-pocm, a dance, a painting, statue or a building, 
the individual does not strive to compiehcnd the meaning of the 
artist, the dancer, or the designer He strives only to catch the 
coordinate whatever reverberations come from the observed thing 
Although stimulated from the outside he makes the response, the 
interpretation which his own mood, experience, and needs call 
forth He "appreciates" in terms of what he is, what he feels and 
understands It is a sort of confident gathering together of the whole 
personality It is an attitude of awareness, as well as one of critique; 
it is all-embracing rather than analytic 

In all three of these altitudes there is of course meaning, gener- 
alization, physical adjustment and emotional content, but there are 
distinctive differences m their amount and integration. The apprecia- 
tive and creative attitudes are effective only to the degree to which 
they are highly charged with emotion The problem-solving attitude 
is effective only to the degiee that the woiker maintains emotion at a 
low ebb. This does not mean that the problem-solver is not also 
gathered-together emotionally. He is concentratctl intently upon 
his task Sometimes a thrilling orientation is perhaps essential to 
success On the other hand it is fiequently the emotional intensity 
of concentration which inhibits the making of appropriate 
generalizations 
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So much, tlieti, for the dilferencea in. orientation of problem-solving, 
creating and appreciating. 

5 

Consider, next the similonties and diffoionces in launching the 
acts themselves. Dewey, m his classic analysis of the coniplotc act 
of thought, leads ua to the step immediately following the recognition 
of tho problem — the flashing up of siiggostions oi solutions In the 
case of pi oblem-solvmg these solutions are hypotheses drawn from 
known data They aie tested against tho requirements of the prob- 
lem. They are generalizations drawn from “facts” and are accepted 
only when under scrutiny they fit the facts 

In the creative act also this flaah-hko succession of fused emotion, 
meaning and movement resembles closely the successive appearance 
of solutions in problem-solving. But, aS in the original orientation 
of the work, there are shaip distinctions between the two processes 
The “suggestions” which flash up to the problem-solver are hypotheses 
from known data. The meaning of each is precisely fixed; generaliza- 
tion must fit the conditions act by the problem itself. In the creative 
piocesa, however, tho suggestions for modifying tho art product are 
measured against tho changing subjective experience of the person 
himself. “Solutions” arc accepted only as he perceives that they 
correspond to his felt moods Thus the point of reference in this 
creative ontorpnac la subjective. 

In appreciating, “analysis'’ of a kind undoubtedly does play a 
part as it does in problem-solving and in creating. In listening to a 
Symphony our enjoyment is enhanced, for example, by noting the 
recurrence of themes, the manner in which the tones of particulai 
groups of instruments merge with others, and the like. Our apprecia- 
tion of a poem or ot prose writing undoubtedly is augmented by 
mastery of form and style which opens to our emotional coinpiehension 
varied channels of enjoyment. Illustrations could be multiplied for 
other media of expression. Theie is no doubt, therefoie, that m the 
fullest development of the appreciative act, the mind attends to 
separate phases or aspects of the process as well as the ensemble 

As m the creative act, however, there is a fundamental distinction 
as to point of reference There is no attempt to make the symphony, 
the landscape, the statue fit into ptesciibed objective standards, 
Wo take fiom the situation what we can. We integrate it with our 
on-flow of experience, but we must not interrupt the process of lecep- 
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tive awareness to dissect critically and judge the validity of the art 
product If we should do the lattei, then the process becomes one of 
pioblem solving and not of appieciation, 

6 

Third, considei the ^‘methods of work,'* the on-going procedure 
itself m pioblem-aolving, cieating and appreciating 

In problem-solving the indivulual ^^collecta/' classifies and 
compares facts If they aic multitudinous, he condenses and sum- 
marizes them by statistical devices These facts arc measured 
against the scales of approximately equal units* Since I have dis- 
cussed this process in earlier chapteis, I shall merely summarize the 
argument by saying that the whole process of problem-solving is one of 
drawing generalizations which fit the external requirements of the 
problem. 

How diffeient is the cieativc method of work* The '^facts^^ are 
the lines, words, or phrases that well up out of the inner recesses of the 
artistes expel lencc, They are the tentative modelings in which the 
sensitive hands of the sculptor or painter attempts to objectify his 
moods and his vision They arc the imagined arrangements of light 
and shade, color and materials m the stage-set and costuming of the 
scenic designer They aie the apparently uncoordinated arrangements 
of materials, dimensions, machine or instrument parts of the mechan- 
ical inventor, They are the interpretive bodily movements of the 
dancer responding to music, 

These are the of the creative process Are they measured 

against external and precisely standardized norms? No, they are 
measuied against the artist’s unique inner sense of the total situation 
to which he is responding. The succession of experiences is a prooes- 
sion of changing, complex, unique situations. Hence, the utter 
impossibility that the artist shall systematically assemble meanings, 
lines, woids, color, what-not m teims of externally known-m-advance 
conditions As with the orientation and initiation of the cieative 
act, the on-going piocess of the work itself is essentially objectification 
of moods, slowly, defining ’ images, gradually shaping mental and 
emotional complexes 

Obviously, meaning and generalization play a selective and 
interpretative i&le as well as emotion Again we say that the creative 
experience is a fusion of physiological processes, meaning, kinaeathetic 
and emotional reaction, Hence, intellectual elements play a part— 



250 


The Journal of Educational Psychologtj 


poihaps a guiding, oncnLiiig part, Definitely what part meaning- 
reacted- through- words plays in dctei mining the actual step-by-step 
advance of the artist’s work wc cannot say at the present stage of the 
analysis of the creative act Wc lack definitive rotiospcclive studica 
by creative artists of the development of tlieir work 

It IS clear, however, that the "analysis” that lends the artist to 
"correct” words or phrases, shapes, lines, arrangements of material, 
light and shade, combinations of tones, bodily movements is a fusion 
of emotion and intellectual meaning, Ideas play a decidedly impor- 
tant selective r6Io in dealing with media tliat are piimanly intolloctual, 
that is, words in poetry and essay, and symbols in mathematical 
invention But they play a very minor building r61e m dealing with 
the media of the giaphic and plastic arts, music and the dance Here 
feeling-import ousts ideas as the directive agent. Thus it is clear that 
analysis plays a part m the carrying on of the creative method of work 
as well as in problcm-solvmg 

This shows itself conspicuously in the conscious effort with which 
the artist gathers himself together, determinedly focuses his mind 
upon the manifestations of Ins moods, and drives himself to define 
the vision which seivos as his inner goal Thus lie adopts an attitude 
of ruthless criticism of the objective portrayal which is appearing on 
his canvas, in his statue or musical composition To tlic best of his 
ability does it correspond with his inner vision? New relationships 
are consciously sought, now combinations of words, Imcs, tones, 
shapes There is a rigoious seaich for new elements in design. There 
IS a dogged detcimmation to discover and build upon unifying themes. 
This process inevitably shaipens the vision as well as produces a 
maturing objective expression Thus the on-going analytical piocess 
of tlie creative act clarifies l>oth the innci subjective state and the outer 
objective product. 

The goal in the act of appreciation, as wc have already pointed out, 
18 fullest awaiencss The govcining attitude is a gathei'cd-together 
receptiveness, an attempt to embrace all the rcvciberations that radiate 
from the words, the tones, the lines, the mosses of color, or the move- 
ments of the body, in the stimulating situation The process is essen- 
tially one of "listening, ” not of making and doing. Ilcre is an example 
of "assimilation” that is closely akin to the cicatvvc act and quite 
foreign to the "assimilation” of the problem-solving act. In appreciat- 
ing we assimilate stimuli of lone, movement, or word-meaning, into 
our curicnt moods We "enjoy,” thrill over the new nssimilation. 
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We build il into oui ^'expeiienco We accept it, embiace it, aie 
lifted up, earned onward 

''Analysis’' plays its constructive pail in appreciating also, but it 
is more like creating than problem-solving. In music, for example, the 
individual '"notes" the use of specially related tones and chords, the 
recurience of basal themes, the integral unity of the composition To 
the extent that he is a master of the technical foims of constiuction, 
his enjoyment is enhanced by the recognition of the arUst's techniques. 
Thus analysis leads the listener to cicate a new inner pioductj his 
fusion of impressions is unique; it is "'himself living on the maximum 
heights of appieciation 

But he does not analyze in order to reproduce m himself what the 
artist felt and saw m creating the product ^ If he does so it happens 
by chance^ not by design, That is, he does not analysic to "solve an 
externally-set problem " If he questions, foi example: "Do I get the 
artist's intent?" he at that instant turns from appreciating to prob- 
lem-solving, 

7 

There is a fourth difference to bo noted—nanoely, the difference in 
the definiteness with which the goal of the worker can be visualized and 
the success or failure of achieving it ascertained The problem- 
solver knows in advance the problem he is to solve. It is the discovery 
of the "law" of relationship between factois that change together. 
His method is to discover the exact combination of factors — materials, 
volumes, loads, pressures, repetitions, lengths, masses and the like — 
which will bring about the stated conditions The very statement of 
the pioblem fixes piecisely the goal of the worker, it is unchanging 
throughout the entire mental process 

Not so in the production of a creative thing The goal is the 
clarification of the artist's vision and its objectification He must see 
and feel clearly enough to portray his vision on a canvas, or in a poem 
or dance or musical production The goal of the eicative aitist, 
therefoie, changes constantly The natuie of the creative process is 
tentative and hesitant, there are constant interlineations, erasures, 
the givmg-up of old achievements, the adoption of new experimental 
arrangements Hence, also, thcie is the continual attitude of 
discontent. 


^ Hence the futility of inobt “ciiticiem ” m the artsl 
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One more important distinction remains to be noted between 
the outcome of pToblem-solving and cieativc production. The 
solution of a scientific problem can be definitely confiiincd or refuted, 
that of the artist's problem cannot. It is of the essential nature of 
scientific work that a generalization once acluevecl in the solution of a 
pioblcm IS susceptible of exact confiiination by independent workers 
at other times and places, Indeed^ inferences drawn by the scientific 
worker are not regarded as scientific "law” unless they can be exactly 
confirrned by other workers utilizing the same set of procedures, 
Thus, a central element of the scientific method is the inevitability 
of the discovery of reourrence. 

Exactly the opposite is true with the creative product The goal 
of creative production must be a unique thing It is a painting, a 
poem, a tone poem, an oiation, which is an objective portrait of an 
inner personality Hence the impossibility of confirmation, or of 
refutation of the product of such a personality by another 

By what standards shall its confiimntion be measuied? By 
whom is it to be confiimed or refuted? The product is the artist's 
personal record of Self, At any given moment no two human beings 
in the world are even approximately alike Thus it is inconceivable 
that, except by the remotest operation of chance alone that the peculiar 
fusion of foeling-impoYt, meaning and bod\\y undevstanding c^chioved 
by an artist could ever be achieved by another, And if they weie so 
achieved, it would not be a "confirmation'' of the original artist's 
‘‘'generalization " It would oithei be sheer imitation, or a new ouginal 
product of the second artist. If it were the latter, it must be meas- 
ured against his personal vision, not against that of the first artiSt 

8 

Our comparison of the acts of problem-solvjng and of creating 
throws light upon the curient confusion of thought concerning ‘Repre- 
sentative art" and "^creative art” m the schools Wo can see now that 
these differ definitely, but that each is necessary in the education of the 
cultured youth and in the progressive reconstruction of society, 
Each plays its important rflle in developing tolerant undei standing and 
dynamic participation in modern life. To get the issue clearly before 
us let us first illustrate what is meant by “representation,” by “repre- 
sentative” art, 

Trom the classrooms of the child-centered schools emerge a host 
of thrilling illustrations of the use of representative art In a first 
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grade unit on local community life is a model of a miniature city. 
Grocery store, post office, city hall, town park, railroad station, each 
item made by a pupil in the class. Together these part- way creatwe 
products constitute a representation of the community. 

Likewise, m the fourth giadc is a more mature repieseatation of 
the community, a map drawn roughly to scale showing the districts 
of the city, rivers, chief industries, names of transporting and communi- 
cating facilities, schools, municipal government buildings, and residence 
districts Here, too, is ^^representation, of a more mature type, 
however, than that of the first giade *^play city/^ 

Consider another — a dramatization of a play written by children 
in the fifth grade depicting stages of community development, 
‘'Research” has been earned on by the young people to make the 
costumes, appearance of houses, farms, factories and stores “represent” 
fairly the civilization depicted* 

A sixth grade class has been studying the European background 
of Ameiican history Witness the models of medieval castles and 
towns, a painting depicting life on an English manor, another illustrat- 
ing transpoitation in the sixteenth century, 

These examples, culled from the experimentation of the new schools 
thiow into clear relief both the importance of representative ait in the 
schools and of its essential chaiacteiisties. At the same time they 
provide us with clear illustration of the distinctions and the similarities 
between representative art and creative art. Note these succinctly. 

First, representation employs the essential attitudes and procedures 
of problem-solving. The individual confronts a problem, namely 
that of portraying with relative fidelity the life of the region, group or 
period, or the structure and form of the plant, animal or society under 
consideration. The orientation is upon a stated set of conditions, 
factors, needs, it is outwaid toward an externally set problem 

Second, the student collects “facts” as in problem-solving He 
searches foi historically correct models, for mformation conceining 
costumes, modes of transportation, language, what-not In “repie- 
senting” life he is obligated to approximate the “truth ” He attempts 
to get a “true” feeling for the life of the group, the community, the 
nation m the peiiod under consideration 

In the third place, a necessary measure of onc^s success in repreBon" 
tation is the degree to which he convoys a message to an audience, the 
degree to which he portrays to others a corresponding feeling for the 
life which is being depicted This is the very essence of representative 
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art. That it is esaeutial to the sound carrying on of the education of 
youth IS clear Scholarlyj technically sound, repiesentative art must 
occupy a gio-wing sphere of influence in our progressive schools 

But imperatively essential as it is, lepresentative art must not be 
confused with creative art in which the individual's objective portrayal 
is not controlled by the desire to reproduce either current oi earlier 
forms and conditions of life, The outline which wo have already given 
of the representative process of the creative process show clearly the 
likeness of the former to pioblcm-solving and the clear distinctions of 
the*latter 

Two conclusions of crucial importance are possible as a result of bins 
discussion: representative art and creative art are two different 

things; second, both are necessary m oui schools Representative 
aifc will supply a crucially needed means of artistic expression in 
build mg a clear understanding of our changing society Creative art is 
indispensable to the complete development of the cultured man 



TETRAD-DIFFERENCES FOR VERBAL SUBTESTS* 
WfLLIAM STEPrrENSON 
UniveiHity College, Londoi) Utnvoisily 
Introduction 

A group Icslf of “verbal” subiests was applied by the author to 
1037 girls, followed on the next day (per testing group) by a gioup test 
of "non-verbal” subtests The latter lias leceived attention in a 
pievious paper.’ The purpose of the present paper is to deteimme 
what we can of the factor-eharacteristics of the verbal subtests, 
relative to the veibal sub testa themaolvcs. Data will be gathered con- 
cerning the satisfaction of the Theoiy of Two Additive Factoi's by 
veibal material Further consideiation must needs be given to enor 
other than sampling in the tctrad-differcnccs: As we suggested in the 
previous aifciclo,’ sampling is likely to be only one of many somees of 
eiror For small populations sampling error is large in comparison 
with most other sources of eiior iii tetrads that we have knowledge of 
But while sampling erroi is diminished by increase of population, we 
may have no such control for other errors; Erroi a insignificant (relative 
to sampling) for small populations must needs become more and more 
observable as sampling eiior is diminished Thus, contempoipneously 
with examination of material in terms of the Theory of Two Factors, 
we must give consideration to error other than sampling, and knowl- 
edge of such enors is one of the objects of our woik 

The Verbal Subtests 

The verbal group lost consisted of eight subtests, named “verbal” 
because the test-units made use of pimlcd woids, plnases, or sentences 
or paiagraphs Samples of the subtest test-units follow, each test- 
unit showing con Cot i espouses Each subtest will be known hereafter 
by its numbei 1, 2, etc. 

iHuhiest 1 — SyiioiiyiTis (mvcntivc’) (Responses in italics ) 

1 tail high 

2 sharp quick 

Suites t 2, — Sentence completion 

1 Birds build their neats m Spung 

The authoi is gieatly indebted to Profcasoi C Spearman, undei whom the 
woik reported heie was accomplished 

^Journal of Educational Psychology ^ Marcli, 1931 

2B6 
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Siihtest 3 — Cksaificaiion 

1 cap atocking coat (tolXeQ gii! wear Bcarf nut) 

2 dog cow (bnok. pmt kitten coal tm) 

Suhtesl 4 —Interchanged wordG 

1 greonlioU8G3 aic grown m tomatoes 

2, Tho dark had long giil hain 
Suhtcsl 6 — Oppoaitos* 

1 come fill go ton 

2 every success onco railuic 

6 —Analogies. 

1 oat: kitten , dog* (horse puppy foorl mieo catkin) 

7 * — Always has 

1. A man always has a (oigai body wife money head) 

2 A bird always hag (cage seed wings nests legs) 

SuUesl 8 >— Following directions 

1 'Write the first letter of tho alphabet ( A ) 

o 

2, Put an *'x ” under an in the answer space ( x ) 

Each subtest occupied one side of a sheet of paper, quarto size. 
The material, was typewrit tcn-cyolostyled, print being high 

(small letters) The stapled sheets were given to the testees with 
BUbtest No 1 showing, and the vaiioiia matters of teat routine were 
gone through with aubtest No 1 as a sample. Each subtest was pref- 
aced by a set of six lest-uiuts displayed and worked through on the 
classroom blackboard, the teat-units being printed and spaced as in tho 
paiticular subtesL 


Tadlu I 


Siibtrst 

Number 
of test- 
units 

Time 

allowed 

in 

minutes 

Mean of 
Guide 
scores 

Sigma of 
crude 
scorei? 

1 Synouyma . . 



8 sa 


2» Sente noo completion . , 

26 

4 



3 Classification 

24 


7 83 

3 22 

4, Interchanged words 


3 

C 36 

2 33 

6. Opposites , 


3 

8 32 

3 18 

6. Analogies, 

25 

m 

7 53 


7. Always lias .. . , 


3 

0 54 

3 24 

8 DIreotionB 

14 

m 


1 72 
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The subtests in order of application, time allowances, number of 
test-units, and crude scores and sigmas, aie given in Table I. The 
whole gioup test took forty minutes for complete application 

iNTEllCOmiEIiATrONS AND TeTRAD-DIFPBRENCES 

Crude Scores, — Intei'corielations for subtests 1 to 8, with age, 
arc given m Table II. The difference formula for ? was used, for crude 
scores The correlations aie a result of checkings, both in the normal 
couise, and at the instigation of the tetrad-dififcienoes themselves. 
We examine the correlations in teims of the Spcaiinan Theory of Two 


TwLB II — Phodoct-mombkt ConnELATioNs for 1037 Gmi,s, Crude Scorbs, 

VEnnAJ- Subtests 



Compared with other disturbances to be considered, age efi’eol is but 
slight Table 11 provides the following tetrad data. 

Mean of 210 tctrod-diffetenceB , 0 0323 

Conventioiinl obseived pe (Menu X 0 8453) 0 0273 

Thcotetacal PE (16A®) 0 0104 

We thus find erioi in the tetiacls, ovei and above that attributable 
to sampling 

The tetrads involving subtest No 1 have obseiwed pe of amount 
0 0363, and supply some of the laigcst of the 210 tetrnd-differeuces. 
This subtest was introduced as a “shoclc-absoibei," and was in view 
of the girls during the pieliminary explanations of testing loutinc — 
It is piobably potent ns a distuibei of tetrads because of a bias for 
"speed ” It seems that we cannot take liberties of the kind granted 
to subtest No 1, without having disturbances icsulting in tetrads 
which involve the subtest In the circumstances it is peihaps legili- 
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mate to omit subtost No 1 from all further deliberations and this, m 
any case, is the procedure adopted: Its retention would not greatly 
effect the data obtained from consideration of the remaining seven 
subtests. The latter, subteats 2 to 8, provide 105 tetrad-differences: 


Mean of 105 tctiad-diftcronocB , 

0 0229 

Observed po (Mean X 0 8463) 

0 0194 

Observed sigma (0.0745'\/S£V7i)* 

0 0187 

Theoretical PB approxnnatoly . 

. . 0 0104 


* Wheio (. stands for totrad-diOeience, thou number 

We note erroi of amount about 0.015 in excess of that that can be 
attnbuted to sampling. 

Standard ^^NormaV^ Scores . — Following the procedure already used 
for the non-verbal subtests, the crude scores used for the corielations 
of Table II were converted to the standard ^'noimar' scores given 
previously ^ Siibtest No 1 was not rescaled. After rescaling, all the 
subtests have the same '^normal'^ distribution of scores The new 


Table III, — Product-moment Couuh}Lation9 pott 1037 Giulb Standard 
“Noumal" Scores; Vckbal .Subtebts 



2 

3 

1 4 


6 

7 

8 

1 

2 


0013 

6689 

6085 

5070 

6845 

5883 

a 



4023 j 

5924 

5260 

5600 

5106 

4 




4474 

4503 

5019 

5046 

5 



1 


C650 

5746 

5121 

6 





, 

5607 

5220 

7 





, 


5920 

8 



! 






correlations for subteats 2 to 8 so rescaled are given in Table III, age 
being neglected. The mean intercorrelation is now 0 5124, compared 
with 0.6456 for the corresponding ? ’s of Table II Table III provides 
the following data: 


Mean of 105 tetrad-diffoioiicc^ 

0 0249 

Obscived po (Mean X 0 8463) 

0 0211 

Observed sigma (0 6746'\/St®/u>* 

0 0202 

TliQorotical PE approximately, 

0 0104 


^Whcio / etnnda for tetrad-clifforonco, n thoir luimbci 

It IS apparent, fchen^ that the rescaling has not freed the table of 
the excess error observed for Table II Our immediate object is 
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to search for acceptable disturbances in these tetrads Throughout 
we shall make use of Table III, the corielations being there free from 
scaling anomalies 

Consideration ov the Residual Error 

Ago IS of but slight effect on the tetiads and, from our experience 
with the non-verbal subtests, we take the correlational calculations 
to be too accurate to allow of calculational mistakes being suggested 
as an explanation of the error obtained for the tetrads of Table HI 
What has been said in a previous paper^ concerning calculation mis^ 
takes holds equally well here: There must be some error attributable to 
calculational mistakes, but we take it to be slight; and the various 
correlations should be relied upon even if it is found that the tetrad- 
differences are slightly inaccurate, because the correlations receive 
most attention. The calculations for Table II were quite different, 
from beginning to end, from those for Tabic III: The crude scalings 
were satisfactory approximate ^'normal'' distributions, so that the 
correlations for Table II should differ but little from those for Table 
III As we see, the correlations are in fact but little different. Such 
considerations, and similar details to be observed in the course of our 
work, together with the help provided by instituting recheokmgs of 
calculations at the investigation of the tetrads themselves (a correlation 
associated with large tetrad-differences is first suspected of cal- 
culational mistakes, and recheckmg is made for that correlation), tend 
to verify our acceptance of the various correlations as being reasonably 
free from calculational mistakes 

We can isolate no single specificality in the case of Table III (or II), 
i.e,, none showing uniquely, as m the case of the rn yitf correlation or 
the non-verbal subtests J Wc therefore proceed to examine Table III 
m the light of influences already known to us, so that, by eliminating 
some, a limited number may be left for final consideration 

Stmtlaniy of Relahons — The Classification, Opposites, and Anal- 
ogy subtests (3, 5, and 6 respectively) involve very similar “likeness, 
or “unlikeness, eduction — ^the classification test-uiiiLs can be answered 
in terms of “not-sinailai,” oi “opposite,’’ the analogy test-units 
involve both “opposites” and “similars,” while the opposites test- 
nnits likewise sometimes may imply “similars ” Thus, foi example, 
the analogy test-unit is constructed of “opposites” m the following 
sample: 
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black white” dark; 


Now these three siibtests have been found by Davey^ to entail specif- 
Kjality which, not unreasonably, was attributed to loo groat sunilavity 
of the relations involved in the teat-units. It is probably, then, that 
the same effect enters into oui sublcats We can free our data of such 
an effect by omitting all tetrads involving rae, I’ao, and ua, leaving for 
consideration the tetrads that cannot be disturbed by the piobable 
spccificahty The process leaves 57 tetrads, with observed pe (con- 
ventional, t.e , observed mean X 0.8463) of value 0 0181, the 
theoretical PE being approximately 0 0104 Hence, even were specif- 
icality acceptable for these correlations, the residual error for Table III 
is just slightly i educed by eliniinatmg the distuibance 

"Idiosi/ncrasies ” — Of other possible disturbers of tetjads pievious 
mention has been made of Icst-consliuctor's idiosynoiasios Thus, a 
battery of Thorndike CAVD subtosls compared (by means of the 
tetrad technique) with, say, Spcaiman oral subtests, shows speoificality 
in the one set of subtests iclative to the other.® The speoificality may 
bo due to the fact that the Spearman test-units aic oially presented; 
or to scholn.stic influences m the Thorndike test-units (showing in 
Arithmetic, Word-abihty, Understanding of paragraphs, etc); or, 
indeed, to both oi othei influences. 

Now of the verbal subtests in Table HI, Nos 2 and 6 weic largely 
Thorndike GAVD test-units (sentence-completion and opposites), 
while the olheis were of my own construction (although following well- 
known patterns) The tetrads for the five subtests of jny construc- 
tion (3, 4, 6, 7, and 8) have value as follows: 


Menu of 15 tetj ncl-difi’eroncejs 

0 0148 

Menu X 0 8453 (obsCivecl pe) 

0 0125 

Tiicoietical PE appi'oximatelv 

0 0106 

It is of interest to note that the laigcst tetrads among these 16 

are associated with the conelation r^o (consideied above) 
^30 gives 9 tetrads with value. 

: Omission of 

Mean of 9 totTad-dibeicnccs 

0 0131 

Mean X 0 8453 (obscivccl pc) 

0 OUI 

Theoiotical PE appioximatoly 

0 0105 


(It the compaiable correlations for ciude scores are considered 
the tetrads still show eiior of amount 0 015 when ?jo is omitted: So 
that if we accept the calculations, eiioi of amount 0 015 appeais to 
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arise from scalmg anomalies, a result in accordance WLth conclusions 
drawn m the previous paper^"^ 

The subtests 2 and 5 may be disturbed by difficult or unfamiliar 
words] subtests 3, 6, 7, and 8 contain only what must be taken to be 
familiar words with “concrete*^ meaning (see the various samples 
already given) and verbal subtests less influenced by critical word- 
ability could scarcely be constructed Subtest 4 involves somewhat 
complex sentences, with abstract structure. 

The omission of tetrads involving ?’26 would free the tetrads for 
Table III of any influence characterizing these two subtests alone 
But residual error of amount 0 019 remains if r 25 alone is omitted from 
the tetrads for Table III, and if, in addition, we omit tetrads involving 
raB, rui and tbo, so making allowance for possible ^ ^similarity of rela- 
tions/^ this residual error becomes 0.018 (over and above sampling 
error) Thus idiosyncrasy for subtests 2 and 5 provides no obvious 
apecificality relative to the other subtests. 

The author^s work with various group tests— such as the Otis, 
Spearman, National, Thorndike, etc — has shown the potency of 
influences entailed in different test-units constructed by one and the 
same psychologist:® Above, wo suggest, is an example of the same 
phenomenon. Had the author constructed the eight verbal subtests 
himself, (in passing we note that subtest No. 1 was taken from work by 
Slocombe®) he is of opinion that the eight might have shown agreement 
with the tetrad criterion as satisfactory as that shown by 3, 4, 6, 7, and 
8. Subtesls 2 and 5, acting as ''reference values, show that dis- 
turbances are latent m the five subtests 

Speed Preference ** — An example of speed preference is given in the 
previous paper/ for subtests 11 and VIII We found that the effect 
could be controlled in terms of the eirors made in sub test VIII 

Subtests 2, 4, and 8 (and 1) weie free from errors Each test-unit 
was either fully coriect or not attempted Subtests 3, 5, 6, and 7, 
show frequent errors Sheer guessing, the scoies indicated, was rare. 
We judge intiospectively, and from the prevalence of mistakes made 
by the testees, that subtests 3, 6, and 7, are most likely to entail a 
“speed” effect Subtest 5 is ostensibly similar to 3, 6, and 7, and may 
be judged to entail “speed preference”, but the test-units in aubtest 5 
have qualities that do not lend themselves to “speed preference ” 
Furthermore, rzh and have received piior notice in terms of similar- 
ity of relations, and the inclusion of these correlations in the tetrads 
about to be considered la open to criticism on that account The 
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influence of “speed” will be most noliceable m tetrads of the type 

“ ^«igi ' ^ (l) 

(s stands for a sublcst involving "speed preference/’ such as 3, 6, and 
7; and q for a subtest token to be satisfactory for the speed-quality 
functioning) 

There aic 36 such tetrads for the s subtests 3, 6, 7, and 5, taken 
together with the g eubteets 2, i, and 8 These have observed pe 
0.028 — quite a significont result Omitting these 36 tetrads from the 
full 105 for Table III leaves 69 tetiads, with value 

Mean of GO tctrnd-din'cicnccs. , 0 0200 

Mem X 0 8403 (conventional pc) , 0 0174 

Theorelicnl PE approximately, , 0 0106 

Blit if subtest 5 is not taken to be “speed” biased or, if prior regard 
is taken of the similarity of relations noted for rat and r^e (and probably 
rjs), then the mean of 18 tetrads of form (1) for 5 subteats 3, 6, 7, 
and q subtests 2, 4, 8, is 0 024 : And elimination of these loaves the 
tetrads for Table III undimmiahod Wc see, then, veiy little clear 
evidence that “speed preference" has entered significantly in our 
subtests, judged, that is, among themselves. The evidonce, of course, 
might be otherwise if different “leferencc values" aie employed. 

"Propinquity*' Influences . — These influences may be attiibutcd to 
objective or subjective fatigue (cspceially when the testing time is 
lengthy, taking two hours or so) ns “habituation,” and as “end-apurt.” 
Calculation mistakes may be suspected too, especially in j’la— which 
18 usually the first correlation calculated The influences show in 
tetrads of the type : 

I'll • rjg — ri7 )'28 = / 

Control of such influences was attempted m our work, Subtest 1 
has been omitted from calculations partly because it served as an 
“habituation,” or “shock,” absorber, the testing time was reasonably 
short; subtest 7 was quite unlike subtest 8 m routine requirements, so 
tending to break any “set” towaid extia effort in the last two subtests; 
every endeavour was made to dispel initial indifference, apprehension, 
or “speed preference." 

The observed conventional pe of all tetrads involving m is 0 0244. 
But the largest of these tetrads have rju and ? eg likewise on the left- 
hand side of the above type of equations, and omission of tetrads 
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involving these corielaiions leaves 16 tetrads, now with pe 0.0205, 
Omission of all tetrads involving } js, ? sb, and leaves 51 for Table III^ 
with pe 0 01 G8 However, ivhat little evidence may be got from these 
results for ? m is offset by the fact that no disturbance is apparent for 
?78 when the author’s subtests alone are congideied (sec section on 
Idiosyriciasios) The data thus give no indication of disturbances 
attributable to propinquity effects 

The Influence of Testing by Gioiips — This has been suggested by 
Professor Spearman^ as a likely source of error in tetxads In the case 
of tJiG piesent verbal material a check of the influence can be made by 
calculating separate correlations for each group of girls tested, averag- 
ing the coirelations so obtained For our 1037 girls we had 21 testing 
groups. The calculation mistakes entailed in working out such a 
large number of corielations might outweigh the eiror to be expected 
as attiibu table to gioup testing It is possible that, by calculating 
separate correlations foi each testing gioup, we might arrive at mter- 
correlationa giving sampling error values to the tetrads for Table IIL 
But we would be concerned with the slight specificahties under con- 
sideration for Table III, the whole being relative to the verbal subtests 
themselves 

We note that no error need be (nor can be) attributed to group 
testing anomalies in the case of the non-verbal subtests* And the 
largest error available in the ease of the verbal subtests can be of the 
Older 0 015 only In the case of the five subtests constructed by 
the author, 3, 4, 6, 7, and 8, there need be no error attributable to 
group testing anomalies. 

But there can be no doubt that gioup testing, on occasion, may 
introduce large disturbances m tetrads Thus, correlations may be 
much influenced if one class, having been taught geometry, is given a 
test involving geometry, while other classes, given the same test, have 
received no such insti action in geometry. It may be taken, we 
suggest, that our non-verbal subtests would bo most open to influences 
of this kind (consider, for instance, the subtests III, VI, and VIII as 
given in the previous article’^) Except m terms of vocabulary 
instruction, such influences cannot leadily be taken to enter the verbal 
subtests Previous practice with similar subtests would not cause 
distuibanccs in the tetrads, if oil the sub tests leceived the practice, 
or, in effect, received the practice Group testing may introduce 
disturbances in other ways; for example by mistakes in tuning subtests, 
or through faults in testing technique for particular sub tests foi some 
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testing groups. All the testing was clone by the author, and sugges- 
tions of timing or lest application or marking faults can be 
discountenanced. 

A procpdure to be closcribed in the next section might be cvpected 
to negate broad influences that may anae because of group testing- 
The procedure leads to no material diminution ot the evrov m the 
tetrads for Table III. 

The Influence of School and Class — Aa has been reported in the 
previous paper,’ the girls for our work were drawn from cloven schools, 
and from Standards IVA to VIIB in those achools (see Table IP), 
Certain schools were by repute of better standing than others IVe 
could determine intercorrelations for the subleats and leputed school 
standing Similarly, a point scale could be made for school standard. 
The influence of school and school standard could then bo partialled 
out Instead of making two sols of corielations necessary, our 
purpose can be served by combining both reputed standing and school 
standard (class) into ono mcasuie. A 16-point scale was devised 
(liercaftcr oalled the C-measuro), the foundation being the order of 
class (LVA to VIIB) within which girls of classes with high reputation 
were accommodated The various Standaids IV were scaled 0, 1, 2 
etc,, where the reputed “poorest" school was scaled 0. The score 
was the same for every girl m a particular class*. And it depended upon 
opinion given by teachers, upon scholniship returns, and, objectively, 
upon the school class. We believe the C-mcasuro to bo a satisfactory 
inea,9ure of the relative schooling and environmental influences 
exerted on tho girls 

To Table III we can now add the following coi relations of the 
subtests 2 to 8 with the C-mcasure 0 4598, 0.4291, 0.3130, 0 3669, 
0,4163, 0.4451, 0.4110, respectively. 

The partial correlations, for the C-moasuie paitialled out were 
next calculated, and the coi relations provided tetrads with the follow- 
ing value; 

Moan of 106 totiocE-dilTcicncea, Table HI, witli C-measuro 
paitialled out. , , 0 0263 

Oliaevvcd po (Mean X 0 8453) . . 0 0214 

Tlicoratioal PE approximately . . 0 0106 

]?Mrthovmore, wo can try out all the vaiious possible influences 
discuesed in the previous secUons, using the paitial correlations 
instead of those given m Table III In all oases the conclusions 
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ari'ived at aie in no way difforent from those arnved at for Table III 
The disposition of error m the tetrads still shows rac and rso as sources 
of large chffeicnces; a try out of the theory of “speed preferences'^ 
gives much the same results; and the five siibtesta constructed by the 
author again have good agreement with Che tetrad ciifcerioii. Thus, 
It IS not in terms of a G-measiirc that residual error m the tetrads for 
the verbal aubtests can be explained. 

The InJlxicncG of ^*Verhahty'' — Ostensible characteristics of the 
verbal subtests are as follows 

(a) Subtesta 2, 4, and involve phinscs and &cntcncca orahoit paragiapha. 
(t) SvvbtGst B (ami 1 to a clog\cc) Gutioally entails difftcuH words— for 
instance, Icab-units of this type, 

**airy uniform blithe divcisificd” 

(c) Subtests 3, 6, and 7, make use of simple wouls, all ivell ivitliiii easy undei- 
standing of the girls tested (t e , according to thoiv (/‘ability — we do not suggest 
that tlio dullest giil tested bad knowledge of all the woids in these sub tests) 
(It IS this easiness of vocabulary, and simplicity of the relations involved, that 
makes subteats 3, 0, and 7 particularly open to “speed" influences ) 

{(1) Siibtest 8 also involves easy woids, equally imderstandablc by the giils, 
but wo cannot readily take it to be "speed" biased 

(e) Sub testa 2 and 4 aic not so critical for vocabulary as is sub test 6 Sub- 
tcats 2 and 4, howover, arc supeificially much alike — both arc essentially “sen- 
tence completion " 

(/) A generalization fiom influences of the kind just passed in review ((a) 
to (c)) IS got in. terms of the fact that foi any given fundaments — qf Nvords, or 
phinsos, or othei linguistic stnictuic — a on licnl inattci may bo (1) either that the 
word 01 phinsQ, etc has to lecnll meaning, oi (2) that meaning (alicady educed) 
has to recall woids or phrases, etc Tlius, ^eproduchout recall of a word or phinse 
01 mcaiuiig, may be oritienl in some test-units But, education, not reproduction, 
chaiacteiizes the universal (/-factor, and critical rcpioduction may thus possibly 
act as a distuibor of tetiads 

What, then, haa our data to offer concerning the above character- 
istics and influences? Obviously it will be of greatest value to refer 
the verbal material to the non-verbal subtests, keeping in mind the 
above possible influences This, however, is to be our concern later 
For the present wo note the following facts 

Tetrads of type (1) for s as subtests 3, 6, and 7 (taken two at a 
time) and q as subtests 2, 4, 5, and 8 (two at a time), have observed 
conventional pe 0.0201, while the observed pe for all the other tetrads 
of the table is 0 0216 If we allow for disturbances attributed 
to "siinilarity of relations” the obseivcd pe for tetrads of type (1) 
becomes 0 0174, compared with 0.0178 for the rest of the tetrads of 
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the table There is no evidence, then, for spccificality in sublests 
2, 4, 5, and 8, relative to 3, 6, and 7, le,, nothing is obseived of the 
nature of a “speed preference’’ foi subtests 3, 6, and 7, and nothing m 
terms of “verbal ability” in snbtcsts 2, 4, 5, and 8 (for dilTicult vocabu- 
lary and understanding of connected discourse). This conclusion, of 
comse, 18 relative to the verbal subtests amongst themselves. The 
results do not seem to piomise assistance by offering explanations of 
the excess error obtained in the tetrads for Table III. 

In terms of the verbal subtests alone, it would bo making too 
much of our material to enter into the possible influences of reprodiic- 
tim on the tetrads. Should a sufficiently broad spccificality be 
observed in the verbal subtests relative to the non-verbal subtests, 
which receives no acceptablo explanation in toims of influences such 
as those of “speed preference,” "Khosynciosies,” "group testing/’ 
and the like, then a most impot tant source of disturbances of tetrads 
might well be reprodttchon effects AH this, however, is a matter for 
future consi delation. 


and CONCnUBlONB 

We have applied the Theory of Two Factors to the intcrcorrelations 
for Tabic III, and find that the obseived error in the tetrads is slightly 
in excess of that expected from sampling crior alone 

Previous work confined to verbal sublcsts has shown some agree- 
ment with the tctrad-diffcicnce ciiterion, but most of the previous data 
are for small populations only, wlieie the sampling error is large in 
comparison with other errors, so swamping them. When, however, 
the sampling error is small (as in our work) some observed excess 
error, of the kind that wo have found, is to be anticipated and, indeed, 
18 demanded by the Theory of Two Factois The observed excess 
error for Tabic III, then, is not incompatible with the Theory But 
the elimination of such small excess enors would only slightly reduce 
the {/-saturation of the correlations. 

Our problem has been that of seeking acceptable explanations for 
the excess observed crior in the tetrads for Table III We have 
applied to our data certain thcoiies of disturbances of tetrads that have 
been found of explanatory value in previous work, trying, in particular, 
the influences of ago effects, calculation mistakes, “speed prcfoienccs," 
“propinquity,” tester’s idiosyncrasies, school and class, gioup testing 
anomalies, and “similarity of relations.” Of the various suggested 
disturbers of tetrads, that of “similarity of relations” for the Analogy, 
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Opposites, and Classification subtests appears to be the most dis- 
cernible, but it is not at the root of the major part of the observed 
excess error. " Speed preference," age, school and class, and superficial 
verbal likenesses of the subtests, give no clear indication of being 
appreciably contributory to the excess enor. We are in some doubt 
about the magnitude of error attributable to group testing anomalies. 
Error is perhaps likely, but the non-verbal subtests’ gave no indication 
of being so influenced, and it is perhaps among these subtests that 
we might most expect such group testing effects to be disturbers of 
tetrads. We find, then, that none of these suggested probable dis- 
turbers singly can be taken to account fully foi the observed excess 
error m the tetrads for Table III. The sources of error so far brought 
forward appear to be inadequate to explain the whole of the excess 
error 

We might accept, piovisionally, a theory that a sum of many 
small disturbances of the kind passed in view m the course of our 
papci may be taken to explain the observed excess error. This 
would mean that elimination of all the suggested small disturbances 
would but slightly icducc the (/-saturation of the coiielations. For 
further light on this matter, however, we must look to comparison of 
the verbal and non-verbal subtests, a study that we are to repoit in the 
next papci. 
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FOUR TYPES OF EXAMINA'JTONS COMPARED AND 

EVALUATED 

ALVIN C EUlUCir 
Uiiivorsity of jVIimiPhota 

Since objective examinations me used so cxlensivcly to measure 
achievement in college courses, it may no longer bc necessary to refer 
lo them as new-type oxaramationa. This docs not imply that auoh 
measures of accomplishment are fully evaluated nor does it oven 
suggest that dihgenl scrutiny of then icsults has become anachronistic. 
In fact the greatci use of these examinations makes imperative even 
more extended studies of their relative validity and reliability as well 
as the mter-rclationship that exists between them. Such investiga- 
tions should be conducted in a rather wide vailcty of specialized 
courses now taught in colleges and univeisitics. The well-known 
work of Wood^ at Columbia University has done much to stimulate 
a widespread interest in evaluating various types of achievement 
examinations that arc now in vogue. The particular investigation 
reported withm these pages is an outgrowth of that interest. Its 
purpose 18 Lo evaluate the essay, completion, multiplc-ohoioe, and true- 
false examinations when each type covers exactly the same subjoct- 

mattGi*. 


Method 

As far as can be determined the unique fcatuic of this investigation 
rests in. the method employed to evaluate the particular types of 
examinations used. In constructing the tests a traditional essay-type 
examination was first prepared to cover the salient points of the 
subject-matter Following the formulation of the questions the 
answers were written out m detail and the total numbei of items to be 
included m each question was thereby determined The next step 
in the procedure was to construct a completion examination covering 
exactly the same material os that embodied in the essay type. To be 
assured of this, the completion statements wore made up from the 
answers to the essay questions. A imiltiplc-ehoioo examination was 
next constructed in the same manner; and following this, a true-false 
examination. Thus the completion, mnltiplc-choice, and true-false 

^Woocl, Bon D , "Mcasurcinont m Higher Education " Woitd Book Co , 
1923 


268 



Four Types of Examinations 269 

testa were each derived from the correct responses to the essay-type 
questions, 

This procedure was followed in two experiments at the University 
of Minnesota. 

The first of these was conducted with a group of students enrolled 
in a covnsc in statistical methods during the first term of the summer 
session of 1927 In the class, Iheio wcie one hundred seven seniors 
and graduate students of the College of Education, ninety-mne of 
whom weic present on the day the tests were administered. 

In the second experiment, the group consisted of one hundred six 
juniors and seniors enrolled in educational psychology during the first 
term of the summer session of 1929 

In both cases the only knowledge which the mcmbcis of the class 
had concerning the experiment was that they were to take a two-liour 
midterm examination They were told that this examination was to 
consist of four parts* Part I, an essay examination, Part II, a comple- 
tion examination, Part III, a multiple-choice examination; and Part 
IV, a true-false examination They wcie further informed that the 
examination would covei all the material in the couise up to the middle 
of the term, 

The total numbci of points in each type of test and the amount 
of testing time allotted are included in Table I for the first experiment 
and Tabic II for the second The examinations used m Experiment 
II were somewhat longei than those in Experiment I although the 
amount of time allotted to each was greater only in the case of the 
true-false test The experience with the first investigation served 
as a basis for this adjustment. The teats are listed in the tables m 
the same order as they were given. 


Table I — Testing Time, Total Points, Means, and Vari^biliti of Scores 
ON Four Types op Tests Used in Experiment I V = 99 


Test 

Testing 
tnne m 

imn- 

ufecs 

Total 

points 

Range 

ot 

scores 

Mean 

PE 

SD 

PE 

CV 

Essay 

35 

69 

20- 61 

39 27 


62 

9 14 

± 

44 

23 27 

Completion 

30 

94 

25- 78 

49 16 

± 

78 

11 44 

± 

56 

23 27 

Molbiple-clioice 

20 

39 

11- 38 

29 41 

± 

33 

4 01 

± 

24 

16 70 

True-false 

15 

60 

28- 46 

30 36 

± 

23 

3 34 

± 

16 

8 49 

CompositG of foiii tests 

100 

252 

109-217 

154 89 

±1 

57 

23 20 

±1 

11 

14 98 
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The scoring of the essay test was somewhat more objective than 
IS usually the case Each atudenVs paper was compared with the 
complete set of answeiB previously worked out, and only those points 
which appeared on the master copy were given credit For the comple- 
tion and inultipie-clioice oxamiiuitions, the number of correct responses 
was considered as the score On the true-false test the score was 
determined by subtracting the number of wrong responses from the 
number right 


Tablk II — Tebtinq Time, Tota^l Pointb, Mhanb and VAi«.unLiTY op Scores 
ON Foun Typer op Tests Ubed in Expeuiment II iV = 106 


Tost 

Testing 
time n\ 

mm- 

utos 

Total 

points 

ItfiiiBe 

of 

scores 

Mean 

PE 

>SD 

PE 

CV 

Essay 

35 

118 




80 

12 10 

± 

60 

29 78 

Completion 

30 

06 


55 28 

i 

84 

12 00 

± 

60 

23 34 

Multiple-choice 

20 

00 


48 44 

± 

48 

7 35 

± 

34 

16 17 

True-falso , , 

20 

75 


39 25 

± 

76 

11 40 

± 

63 

29 04 

CorapoBito of four tests 

105 

358 


171 33 

±2 37 


hi 08 

21 13 


Results 

In the first experiment the four tests varied in their differentiating 
capacity as shown in Table I, An examination of the figures in the 
appropriate column reveals the fact that the standard deviations on 
the essay and completion tests arc larger than on the multiple-choice 
and true-false examinations. The same is true of the coefficients of 
variability This difference is without question due to the nature of 
the particular examinations used rather than due to the type of test. 
The variability measuies for Experiment II (Table II) show that the 
essay, completion, and true-false examinations appear to differentiate 
the students to approximately the same extent. Had the multiple 
choice test been made longer it is very probable that it would have 
differentiated the students equally well. 

In order to determine the extent to which the foui types of tests 
measured the same degree of achiovcmcnl, their iniercorrelations 
were found The coefficients for both experiments aio given m Tabic 
III Considering the tests as given in the fiist cxpciimont it is evi- 
dent that the highest in tercon elation appears between the multiple- 
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Table III — Inteucortielations of Tebts 



Evperiment 1 

Experiment 11 




Corrected 



Corrected 


? 

PE 

for 

T 

PE 

fox 




attojni- 



attenu- 




atioii 



ation 

Essay and completion 

44 

i 05 

02 


1 

1 20 

Essay and muitiple-choice 

47 

± 05 

07 


am 

97 

Essay and true-false 

30 

± oo 

06 

55 

± 05 

89 

Completion and multiple-choice 

57 

± 05 

80 

71 


92 

Completion and true-false 

37 

± 00 

68 

63 

+ 04 

86 

Wiiltjple-chojco and triio-faJse 

44 

± 05 

81 

65 

± 04 

90 


choice and true-false types (r = .57) The lowest exists between the 
essay and true-false examinations (r = ,30) When corrected for 
attenuation, the multiple-choice test correlates about equally as high 
with the completion (.80) as with the true-false type (.81) In the 
second experiment all the intercoi relations are higher The coeffi- 
cient of greatest magnitude is found for the essay and completion 
tests ( 80) The lowest correlation obtains between the essay and 
true-false tests (.55) as in the first experiment. When corrected 
for attenuation the coefRcients in Experiment II range fiom 85 to 
1.20 ^ These high coefficients indicate that if a reliable test is con- 
structed one type is probably as adequate for measuiing the acquisi- 
tion of information in a course as any of the other three types The 
fact that the intercoi lelations are lower in the first experiment than 
in the second is probably due to the lower validity and reliability of 
the first set of tests m comparison with the second, although the sub- 
ject-matter of the tests may also be a factor. 

To evaluate these facts further, correlation coefficients weie 
calculated for the scores on each test and composite scores on the other 
three For example, the essay test was correlated with the composite 
score of the multiple-choice, true-false and completion examinations. 
The same procedure was followed for each of the other teats These 
correlations, which may be called validity coefficients, have been 
placed m Table IV. The values for the tests as used in the first 
experiment appeal m the second column as follows: For the essay, .64; 

* A GoiTGctad coirolation that is greater than 1 00 must be interpreted to mean 
that th<» relationship is neai uni tv 
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for the completion, 68; for the iiuilLiplo-clioice, 66, and for the truc^ 
false, 40, It was further sought to cletcnnmc the viilidity of the 
tests in caso cacli of the foui types was Jiiadc of equal length; that is, 
in case the testing time for each was sixty minutes Thus, the validity 

Taulb l\' — 'rim llDii\TiON ok Each Typo ok Tmr to tub (kjMPoBiTD op the 

OTiimi Tiiupjk 



lixpcniiicnt I j 

Experiment II 


1 Ah corislmclcd 

If inndo 
Bixty mm- 1 
iiicB m 

Sb coiifllriirtcfl 

Tf made 
sixty uim- 
' iilca 111 




longth 

1 


IcrigDi 


r 

1 1»J5 

1 r 

1 1 

1 

1 l‘ri 

r 

Essay 

64 

± 04 

00 

70 

± 03 

84 

Completion . 

68 

± 04 

73 

82 

1 02 

.80 

Miiltiple-clioicc 

GO ' 

± 04 

74 

77 

1 03 

84 

Triic-falao 

40 

-t 00 

r)4 

75 

± 03 

81 

Estimated vnlidily of , 
composite of four | 
testa ' 

70 



80 




coefficients are cslimalcd for the essay test when loss than doubled in 
length, for the completion lest when doubled, for the multiple-choice 
test when tripled, and for the tiuc-falsc test when quadrupled To do 
this the formula for determining the validity of a lengthened lest aa 
given by Holzinger^ was used, The cocflicicnts obtained m this 
manner aio as follows* Essay, 69, completion 73, multiple- choice, 
.74; and true-false, ,54. 

The validity cocflicienU for the tests used in Experiment 11 were 
likewise calculated These aie also inserted in Table V For the 
essay test as constructed, the validity coollicicnt is 76, foi the com- 
pletion, ,82, for the multiple-choice, 77, and for the true-false, 76. 
When estimated for the tests if made of equal length, the coefficients 
are all of approximately the same magnitude They indicate, thcic- 
fore, that the four types of testa used in these oxpciimcnts have 
approximately the same validity (providing the cri tenon is an adequate 
one) The surprising implication of this fact is that the essay type of 
examination, whon scored objcciivoly, appears to be as valid as the 
other so-called obiective cKammationB 

— ■ i 

* Tlolzingei', Kail J. ^“Statiahoal Methods for ISUkUmiIs hi Educalion ” P 170. 
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The rehabihly cocfficicn-la preSGTited m Table V ijvere found by 
securing the Pearsoman r between the odd and even items of the tests 
and estimating with the Spearman-Brown formula. In both of the 
experiments the completion and multiple-choice examinations are 
most reliable In the first, the true-false tost has the lowest reliability 
whereas the essay examination is least reliable in the second. When 
the reliability coefficients are estimated for tests of equal length, the 
completion and multiple-choice types retain their positions as the most 
- reliable tests in both experiments The reliability of the essay exami- 
nation m the first experiment docs not differ markedly from these 
whereas in the second experiment, the essay examination appears to be 
considerably leas reliable The reliability coefficient for the composite 
of the four tests of each experiment was determined by an adaptation 
of Spearman’s formula for the con elation between sums or averages,* 
The coefficients show that the two batteries of tests have approximately 
equal reliability 

T/usiiH Y — Reliasiuty Tests 


Experiment I Experiment II 


TeflU 

As 

conBiruoted 

If msdo sixty 
mlnuteft m 
longbh 

Ab 

oOTisLruotod 

If inado sixty 
n\ 

longth 


r 

P13 

r 

-■ 

PE 

r 

PI3 



PE 

Efieay 

00 

± 04 

70 

± 03 

60 

± 00 

00 

± 04 

ComplQUon 

72 

± 04 

84 

± 02 

80 

± 03 

8Q 

± 02 

Multiple ohoioo 

71 

± 04 

88 

± 02 

76 

± 03 

.00 

± 01 

True-fRlflo 

41 

± Og 

74 

± 06 

GO 

± 04 

87 

± 02 

Composae ot four icatfi 

86 




89 





Another matter of concern was the lelationship of these various 
types of examinations to intelligence The only intelligence test scores 
available for the group of students enrolled in statistical methods were 
those on the Miller Mental Ability Test, Form A. The coefficients 
of correlation between this test and the various types of achievement 
examinations appear in Table VI. The zero order coefficients show 
that the highest degree of relationship exists between Miller A test and 
the completion examination (? = 53), the lowest between the Miller A 

^Kelley, T. h* *‘StatiaUeal Method’' P 198, Douglas, H R and Cozens, 
F, W ‘ On Formula for Estimating the Reliability of Test Battciiea Jovnial of 
Educational Psychology^ VoK XX, 1929, pp 309-377 

^Miller, W S ^'Mental Ability Test " World Book Company 
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and tho essay examination (r = .33). When collected for aLteniiation, 
the coofficients of correlation between the Miller Mental Ability Teat 
With the completion (.08) and wiUi the Iriic-falsc examination (.67) 
are approximately equal, whcrcftH the lowest relationship is found with 
the essay examination. 


TaULU VI — UBLA^riON of 'L’nSTH to iNThT.MOKNCK 




Ex pen moil t I 

experiment II 


Miller MciUal Ability Test 

MjHoi Hard Aimlogies Test 

Teats 







T 

PE 

CoiToetecl foi 

T 

PE 

1 Collected for 




1 attenuation^ ' 

1 

afctenuatioai 

Essay 

33 

i 00 

i 

43 ^ 

34 

± 00 

48 

Completion , . 1 

53 

± 05 

68 ! 

44 

± 05' 

52 

MuUiplc-choico 

42 

± oc>: 

54 

5.3 

± 05 

06 

True-false 

40 

± 06 

67 

55 

+ Of) 

70 

Composite of four tests 

49 ! 

± or> 

57 

53 

1 or, 

50 


^ The scU coiiGlaliou (or the MiUcr X la RG, and for the Aualogiea teat, 
,90 


In the educational psychology class tho Miller Hard Analogies 
Test^ was used as a measure of mtolligcncc. With tins test, which 
18 bettor adapted to the college group than the Miller Mental Ability 
Test, the lelationship between the essay examination and intelligence 
is also tho lowest of those obtained It would seem, tliciefoie, that 
students with relatively good intelhgenco aie leas apt to scouie high 
scores in the essay examination than on tho other three Tins may 
be due to the fact that the foim of tho essay type is much less like the 
form of intelligence tests than are the completion, multiple-choice, and 
true-falsc types. 

After the students completed all four parts of the examination, 
they were asked to write out their order of preference for these types. 
These data are summarized in Table VII for Experuneni I and in 
Table VIII for Experiment II. In both classes the multiple-choice 
examination is placed fiist by a larger percentage of .students than 
any of the other types. The tiue-talsc is placed second, In the first 
experiment the plurality gives the essay examination the third position 
and the completion examination tho fourth In Expoiiment II, 

^ Nob commercially available Picpaied by W. S Mil lei 
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hoTvever, the plurality gives the completion the third position and the 
esaay, the fourth. It is clear that the multiple-choice and true-false 
examinations aie preferred by the students to the essay and com- 
pletion types. 


Table Vlf — Stupent Prefeiibncbb for Bipphrbnt Types op Tests 

Exponmont I 

Type of examination 


Choice 

Essay 

Completion j 

1 Multiple-choice 

j Tiue- false 

N 

For cent 

N 

1 

Per cent | 

N 1 

Per cent j 

AT 

Per cent 

First , 

14 

14 0 

6 

6 6 

40 

43 0 

39 

40 6 


14 

14 9 

6 

6.4 

34 

30 0 

39 

40 6 


44 

40 8 

22 1 

23 0 

16 

16 1 

11 

11 6 


22 

23.4 1 

69 1 

04 1 

4 

4 3 

7 

7 3 

Totals 

94 

100 0 

92 

1 

09 9 

93 

1 

100 0 

96 

100 0 


Table VIII — Student Preferences for Different Types op Tests 

Experiment ir 

Typo of examination 


Choice 

Essay 

Completion 

Miiliiple-choice 

Tiue-falso 

N 

1 Per cent 


Per cent 

w 

Per cent 

N ' 

1 

Per cent 

First 

11 

In 

R 


68 

1 69 8 

1 

I la 4 

Second 


wbm 

WM 



' 27 8 

44 

44 9 

Third 

27 

28 1 

38 

39 2 

9 

9 3 

22 

22 5 

Fourth 

49 

61 0 

30 

30 9 

3 

3 1 

! 

14 3 

Totals 

96 

100 0 

07 

100 0 

97 

100 0 

' 98 

100 1 


Purther analysis was made of these data by tabulating the oider 
of preference for the fifteen individuals securing the highest score and 
for the fifteen securing the lowest score on the intelligence tests 
Table IX presents the figures for these selected groups in the statistical 
methods class while Tabic X presents comparable data from the 
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second experiment Although no generalizations ean bo derived 
from these two tables, it appears that both those of low and high 
intelligence prefer the multiple-choice and true-false tests more than 
they do the other types, In the first experiment theio is a loncloncy 

Taulu IX— Tbpt PuBFumNCBB K»i Tiio lIujin^Kr Rankincj Studunts 

jiND FOR TUB Fifteen Lowest Uankin<* Htu hunts in iNTLUiiOENCU 

KKj)oinunii> 1 


Type of i'xaininalion 


Choice 

lEssay I 

j CoiwploUon 1 

j Mviltiplc-cUoicc 

1 Tru<i-faUe 


1 Highest 

Lowest 1 

jlliglicat 

Lowest j 

II iglicstj lowest 

IIiKhestj 

Lowest 

First, 

0 

S 

1 

0 

7 

4 

7 

G 

Socoiul 

= 3 

2 

2 

0 

6 

0 i 

4 

7 

Thud 

7 

7 

4 

3 1 

2 

4 1 

2 

L 

Fouith 

6 

1 

8 

12 

0 

1 

2 

1 

Totals 

16 

16 

15 

16 1 

15 

16 

16 

16 


TaB^E X — 'V'E.Wt PnEFEUENCEft FOU TIlE Flir^rEEN IIlOllEbT IIaNKINO KTUDl^N'rS 
AN!) FOa THE FlFT'EtJN LOWEST liANKINO >STUnENTH IN InTEEMOUNCE 

Fxpci uncut II 


Type of examination 


Choice 

Essay 

Completion 

MuUiple-ehoiee 

Tnie-ffilHo 


Highcstj 

Lowest 

Hi ghost 

Low est 

Iligliestj 

Lowest 

1 

Ilighcstj 

Low est 

First 

3 

3 

1 

0 

10 

7 

1 

6 

Second 

2 

2 

3 

1 

2 ' 

6 

8 

7 

Third 

2 

4 

6 

6 

1 

3 1 

0 

3 

Fourth 

8 

6 

5 

0 

2 

0 1 

0 

0 

To tals 

16 

15 

15 

15 

15 

16 

15 

16 


for those lowest m inlelhgonce scoies to prefer the essay examination 
more than do those who received the highest ratings. This tendency is 
not as clear in the results from the second experiment In both classes, 
there is a slight tendency for those with the highest mteJligcnco ratings 



Fow Types of Exammahom 277 

to piefer the completion cxammation more than do those mdividuala 
who rank lowest 

Before summauzmg the icsults of this study, a possible explanation 
might bo given for the lack of agreement between the lesults reported 
here and those lepoitcd by other investigators who have considered 
the relative merits of the essay examination* In all probability the 
reason for the i datively high rating of the essay examination m this 
study is the objective rnannci in which it was scoied. The procedure 
followed in scoring these tests is definitely comparable to the method 
of scoring the so-called objective examinations Consequently, 
this evaluation of the essay examination does not serve as a refutation 
for the numerous arguments which appear in the literature opposing it, 
It merely intimates that an essay-type examination may be so given 
and scored as to compare favorably with the objective examinations. 
The labor involved m such a pioccdure, however, is so great as to 
make it almost prohibitive for large classes 

Summary 

1, Four types of examlnalions, each covering exactly the same 
flubject-matlor, were given to a class m statistical methods in education 
and a class in educational psychology* The nature of the four types, 
as well as the oider in which they were given, was as follows' Part 
I, essay; Part II, completion, Part III, multiple-choice; Part IV, 
true-false. 

2 The inter cor relations of the tests in the couise m educational 
psychology suggest that if leliable tests arc constructed, one of the 
foui types used is probably as adequate as any of the other three for 
measuring the amount of infoiimtion which the mcinbeis of the class 
have accumulated The evidence for this suggestion is not as clear- 
cut in the class studying statistical niethods. 

3 If the composite scoie on thice types of examinations is used 
as the cntciion for estimating the validity of the fouitli type, the 
results indicate that the four types of tests have appioximatcly equal 
validity, 

4 In both cxpeiLmeiita the completion and multiplc-choice tests 
prove to be most reliable In the second cxpeiiinent the reliability 
of the true-false cxammation is not much lower 

5, The correlation between intclhgcnce and the essay examination 
.slower than between mtclligenco and cither of the other three types 
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6. Considering the choice of all the students in the two classes 
the multiplc-choicc and true-false tests are preferred to the other two 
types studied. 

7. There is a tendency for the highest ranking studenta in mtelh- 
goncG to prefer the completion examination more than do the lowest 
ranking students. In the first experiment this latter group prefer the 
essay test more than do the members of the highest ranking group 



an experiment designed to test the validity 

OF A FATING TECHNIQUE 

THEODORE NEWCOMB 
WcBtorn lloacrve Univoraity 

I 

The validity of ratings of behavior, provided that two conditions 
arc met, has been faiily generally accepted These conditions are that 
there be several competent judges,^ and that they have ample oppor- 
tunity to observe the behavior being rated. Foi the past two summers 
the writer has been in a situation where both of these conditions were 
adequately met Data were gatheied of such a nature that ratings 
could be compared with moie objective measures of the same behav- 
iors, and enough raters ^YC10 available so that a study of the unif Dimity 
of the ratings could bo made* 

The subjects for each of the studies here leported weie thirty 
problem boys who had been sent for study and treatment to a summer 
camp maintained through the cooperation of Western Reserve Uni- 
versity and the Child Guidance Chnic of Cleveland, Ohio The boys 
remained for a period of five weeks whcie they were under the constant 
observation of a psychiatiist and of six or more counselors trained in 
psychology and mental hygiene. 

The first summer, in connection with another experiment, the 
attempt was made to validate certain objective” measuies of piob* 
lem boy behavior by comparing them with ratings on the same behav- 
ior The results were such as to make the experimenter conclude that 
the ratings were themselves being validated The evidence, however, 
was rather meager, and it was decided to gathei fuller data concerning 
the same problem. 

II 

During the first summer a daily iccoid was kept of ^^specifically 
remembered incidents” included under twenty-six different behaviors.^ 

* Note pai tiGularly llugg, II 0. Is the Rating of Iluitian Gliaraofcer Possible? 
Journal Educaiioiutl Psychology, Vol XII, p 425 and Vol XIII, p 93 Rugg 
concludes that there should lie at least thveo judges who have had a fair gIifhco to 
observe subjects in tlie behaviois being lated 

^For a fiiUei clGscripUou of this cxpcLimont, togother with a description of 
statistical techniques used, see tJio writer's Consistency of Certain. Exti overt- 
intro vort Behavior Patterns in Fifty-ouc Problem Boys " Teachers College 
Contribiitiona to Education, No 382 
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Each boy^s lecoul each day ^vasj kepi on a foim similar to the Following 
sample' 

IIow was he about got ting up in tlio morning? 

Got up bcfoiG ijsirig hour 

Piomptly when called 

Dnlhed, but on time for breakfast. 

Too late to bo on time foi bieakfuftt 

Records were kept for each boy by his own counselor, who had spent 
all or most of the clay with him. Besides tliese daily records, the 
experimenter recorded some 8500 incidents of the above twenty-six 
and other similar behaviors Then, at the end of tho camp period, 
ratings weie obtained from each of seven men on the frequency of 
these same twenty-six behaviors Inasmuch as the observers had 
played, slept, and eaten with tho boys noaily constantly for five weeks, 
a fail degree of accuracy in tho latmgs might be expected. 

Six of the twonty-six behaviors measured, however, were of such a 
kind that no subject had been observed by any but one man— his own 
tent counselor. Nevertheless, each of the seven observers was asked 
to give ratings on these six behaviors also, in terms of supposed or 
imagined frequency. Six of the sevou ratiuga, \u other words, weio 
guesses 

It was not surprising to find a mean ooiyolnUon between daily 
record scores and ratings, of 409 ± .102 foi the twcnty-six behaviors 
The range of correlations was fiom .02 to .73. What was somewhat 
surprising was that tho mean coiiclation foi the six guessed behavlois 
{i e., between daily records and ratings) was fully as high as for the 
twenty observed behaviors The mean for tho former was .451 ± 
098, and foi thelattei, .396 ± ,104. The clifforcncc is not stuhslically 
significant 

The accuracy of the ratings became even moic questionable when, 
as measures of uniformity, standard deviations among the seven ratings 
for each behavioi were computed iTic mean SD foi the twenty 
observed behaviors was 88 (the ratings were on a scale of 1 to 5), and 
for the six guessed bclmviois, ,8l. Again tho difference is not sig- 
nificant, and it is evident that the raters agiced no moie closely about 
frequently observed behavioia than about behaviors which they had 
never seen, 

III 

A year later there was a similar group of boyh at the sainc camp 
Somewhat diffeient means of objective recording of behavior were 
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used, as will be described. More exLensivo ratings were also obtained, 
and the problem of studying thou lelation to ficqucucy of obBcrvaUon 
was diieotly attacked this time, rather than stiiinblmg on to it as a 
side-issue 

Aa before, definilo types of behavioi woic being studied, for 
example, seeking adult attention, Gmds weic niimeogiaphed, on 
which weie listed all the common ways in which boys were actually 
found to seek adult attention When an incideiii of this soil was 
obseivetl, the card was checked with the appropiialo behavior, at 
that time or as soon after ns was possible, Seven or eight obseivors 
who weie constantly on the watch for these specific bchavioiB could " 
be piesumed to get a pretty fail sample of all such incidents that 
occurred Theie follows a samplo card, showing one of the seven 
kinds of boJiavior that weie being studied 

fiCRKlNQ AdUI.T AvI'ENTION 

Date 
Time . 

Obscivoi 

Name of boy 

Hiking abno with ccninscloi 
Voluntarii}’^ woiking nlone wilU counselor 
Hanging around coiijisoloi alone 
Vohiiitecnng in task for counselor 
Hanging aiound conn solo is' nlmck 
Complaining to eoiinsolot of aihnont 
Tattling 

Special invitation to coiiiisoloi 

Antics to annoy or diaw attention of eoiiiiReloi 

Doinoiisliation ot a fleet ion foi eounseloi 

Playing up to visitois 

Othcis (indicate on reveiao side) 

Altogether some fifty specific behavioi s were bemg thus rccoidcd 
day by day. Naturally, some of these wore found to occur with gieat 
frequency, and otheis to bo compaiativcly larc, Tliis matter of fie- 
quency with which the behavior is being leporled may theicforc be 
studied in xclalioii to llio agieemcnt between the two inousurcs of the 
same behaviors 

It was desired to study not only the effect of fiequcncy of reporting 
upon the agreement of the two measures, l)Ut also that of mere fre- 
quency of occurrence of behaviors not being iccoidcd These pro!)- 
leius, added to that of the previous summer, ^ e , a coiupanson of 
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observed wth unobscivcd bchaviois, made a total of aixj^inds of behav- 
iors to be studied, as followh. 

1. Behaviors leeovdt'd vi\ Itvigo owuihciB. 

2. Bclmviois hoiiig irroulrd in Hina 11 numbers 

3. Behaviors not bning rocordod, l^ut occurring frcqxiently (as dotQrmmcd by 
tlio atiidy of tho ptovious aummoi). 

4 Bohaviora not lioing loroidrd, ImL ciecuning rarely (as clelpimincc] by tho 
atiuly of the prcviouB aumincr) 

6 Bclmviois obBcrvccl iii earli bov hv only one obsei ver (Ins own counseloi) 

6 Behaviors never observed ill all — imaginary * 3111^1 ion a 

Ratings wesre thorcfoic obtained on thirty behaviors, five in each of 
tho categories just given. In Tabic I these behaviois mo tabulated, 
together v^ith the results of the ratings In the list as submitted to the 
raters, the behaviors were of course not thus tabulated, but occurred 
in random order, The number preceding each behavior mdicatee 
what tins random order was. 

Directions for ratings were as follows: 

Tho following ratings aio to iiidicato tbc /rc^Mc/ic// with whjcli each behavior 
occurred Pleaac lato os follows' 

0 Novel occurred at all, 

1, Bare, very exceptional, 

2, Oocnsional, not frequont 
3> Paitly frequent, 

4 Very frequent; prominent clmracteristic. 

Indicate tho dcgieo of youi rating hy placing a phis aftci tho figuro if theic 15 a 
fair degree of cor tain ty, a mimis if blicro is con sido table iinceitninty, and otherwise 
no sign 

In the case of behaviors wluoli yon Imvc not observed, make the best possible 
estiinatc of how frequently it would occur 

Bate all the boys for behavior No 1, then all the hoys foi behavior Ko 2, etc, 

Tatjlb I — Bbuaviohh on Wnicii Hatings Wbiib Obtained 
Group I llccoidcd m Large Nuiiibeia 
5 Lying or sitting around alone 
7, Bullying, with physical contact, 

13. Asauming position of promincnco at camp fire 
15 Antics to annoy 01 draw attention of counsclois 
27. Interrupting or shouting above the group, 

Group IL Record oil m Km all Numbers 
1. Being crowded out, avoiding being fust 
3, Taking tho iniiialivo in fighting or lioxing 
18, Complaining to counselor of ailment. 

20 Moping Of sulking alone 
24. Profanity or obscenity 
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Gioup III Not Hccordcd — Frequently Observed 

2 Coming late to meals 
11 Expiossmg enthiiBiasm 
17 Moving filowly ’ivbile otheis hurried, 

21, Ringing nloucl 
23 Laughing 


Group IV Not Recorded — Raicly Obscivcd 

10 Boasting, or loudly nnnounemg intentions foi the future 

12 Contmued cliatting, loqiinciousnesa. 

14 Remaining quiet while others were noiay 

10, Accepting diBcipIme quietlv 

22 Failing to Wash oi comb 

Gioup V Obeeivcd by Only One Coiiiiseloi 

4 Making Ins own bed neatly 

8 Taking more than hia shaie of food at table 

20, Readily concuiiing with tent-mntes’ choice of activity 

29 Doing moie than hi.g share of aftcr-mcal work at camp 

30 Making noise in the tent before rising hour in the morning 

Group VI Never Obscived — Imngmaiy Situations 

0 Stopping play at a picviously agreed upon hour and coming in the house 

9 Playing quietly in oidcr not to disturb sick sister, if asked to do so 

16, Minding the baby all Saturday afternoon, without leaving 

26, Giving up atti active plaything to younger biothei if he asked for it 

28 Tidying up his own lOom at home 

Thirty boys were thus rated on thirty behaviors by six observers. 
As one measure of the uniformity of the ratings, the SD of the six 
ratings was calculated, for each boy for each behavior Correlations 
between ratings and objective scores were also calculated for the ten 
behaviois being recoided (Groups I and II} Eating scores for these 
calculations were obtained by adding the six ratings for each behavior 
by each boy Objective scoies weie simply the total numbers of 
recorded incidents 

Eeliabilitics of the latings were also calculated for each behavior, 
by correlating the sum of the scoies of thiee raters with the sum of the 
other thiee raters This serves as another measure of uniformity 
of the ratings The correlation between these measures of reliability 
and the #SZ)^s for each behavior, is 662, indicating that the two 
methods are measuring at least partly the same thing 

The lesults of all these calculations are given in Table II. 
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Behavior 

number 

Mean of thirtv 
#SZ1 'h 

Coirolatioii 

1 ) 0 tween lialvoH 

CorrolaLion 
with objective 

flCOlC 

Nuinl)cr of 
luculculs 


Gioup 1 — Olwrvod ttiul UoooicUhI Ficqurntly 


5 

7102 

032 

189 

~123 ^ 

7 

7218 

730 

512 

08 

13 

8004 

270 

002 

09 

115 

G042 

816 

G52 

133 

27 

8000 

783 

CIO 

100 

Mean 

731)5 1 

047 

538 

104 0 


Group 11 — Obseived nnd llcrorded Barolv 


1 

70Cr> 

736 

010 

21 

3 

0060 

801 

3 to 

19 

18 

015S 

783 

413 

26 

20 

7110 

028 

15H 

11 

24 

0315 

UOo 

081 

34 

Mean 

0782 

842 

300 

22 0 


Group III — Not Ucroided — Frcquoiitl}^ Obflomd 


2 

7405 1 

607 



11 


703 



17 

8213 

151 



21 





23 

7680 1 




Moan 1 

7711 

1 491 




Gioup IV — Not Uccordpd — Rgicly Gbsoivocl 


10 

7182 

035 



12 

7165 

751 



14 

7977 

778 



19 , 

71S5 

801 



22 

6943 

850 ! 



Mean 

72SD 

763 1 




Gioup V — Not Obacivcd Excopt by One Man 


4 

1 7161 

750 



8 

6097 

1 B4S 



26 

7663 

1 866 



29 

7162 

901 



30 

8300 

479 



Moan 1 

7372 

1 706 




Oioup VI — Ncvoi ObaciTccl — Iiimgitmrv IncidiMits 


0 

8107 

480 

1 


9 

1 7000 

474 



16 

0G29 

730 



26 

7290 

701 



28 

6899 

729 



Mean 

7201 

613 
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Consideiing fiist the corfclalions between the two measures, for 
which calculations wore possible only in Groups I and II, the mean 
coefficients are respectively 538 ± 087, and .390 ± 105 The SD 
of the diffeience of IhcRC two coeflicients, using the foimula 

SDdif j = mean I + (SD* mean II, 

18 1254, the difference being equal to 1.10 sigmas, which can not be 
said to be statistically significant. As fai as agreeing with the more 
objective measures is conceined, then, theic is no significant difference 
between behaviors frequently leeorded and those larely recorded 

The relative unifoimity of the latings for each group of behaviors 
IS fairly obvious from Tabic 11. The mean SB foi the groups of behav- 
iors langes between 6782 for Group II and .7741 for Group III The 
SB of the diffeience between these two values (using the formula 
already cited) is 0282, the difference being equal to 4.6 sigmas While 
this is a great enough difference to indicate probable significance, 
there is no significant cliffercnco between any other two groups of 
behaviors. The difference in this one case would seem to indicate 
that bohaviois being rceoided in small numbeis are more uniformly 
rated than those being frequently observed and not recorded; but not 
significantly more consistently rated than those which were pure 
guesses Groups I and III, which represent behaviors frequently 
observed, have a mean SB of .7395 and .7741, lespeetively, whereas 
Groups V and VI, lepiesenting bchaviois never observed, have mean 
SB’^ of 7372 and 7204, respectively. Neither the fact of being 
observed ficqucntly, nor having been watched for and icpoi ted foi a 
five-week period lent any advantage m unifoimity of rating over the 
ratings which wcie meie guesses 

Theie was a baiely significant difference between behaviors No. 24 
and No. 17, those with the lowest and highest mean SB^a, respectively 
The sigma of the diffeience is 0427, the diffeience being equal to 
4 42 sigmas 

Mean SB's for each boy were also calculated, * e , the mean of the 
thirty behaviors on which each boy was latcd Theie was somewhat 
moie unifoimity here than among the thirty behaviors. The lowest 
and the highest of these mean SB’ a weie, respectively, ,6615 and 
8163. The SB of the difference is .051, the difference being equal 
to 3 03 sigmas. 

That this scarcely represents a real difference is further indicated 
by a calculation of the correlation between the number of recorded 
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incidents for each boy (langing from 26 to 295) and the mean SD 
for each boy This coofflcicnt, represenUng the relation between the 
number of recorded mcicloiita and the variation in ratings was 161 + 
120 This IS probably not surpiising, since the nicie fact of not 
having locordcd many incidents for certain boys would give the 
rater a fair idea of tlio frequency of the behavior being rated. Hence 
boys with few recorded incidents would tend to be ns nccuiately and 
uniformly lated us those with many. 

Very similar results are obtained by comparing the average rcliar 
bllity of the several groups of bclnvviois The only significant diffei- 
ence, again, is between that of Group H and Group III, the difference 
being equal to 4 1 sigmas Wo find the avei age reliability of the five 
guessed behaviors to be almost piccisoly the same as that of the five 
behaviois most frequently scon and rccoided. 

The moan correlation between one half of the latmgs and the other 
half is .683 This gives a reliability, by the use of the Spearraau- 
Brown formula, of .81 In order to aocuio a reliability of .00 it would 
be necessary to have 2.1 times as many lators, oi about twelve. It 
should be added that the boys presented a wide range of behaviors, so 
that a faiily high degico of reliability should be expected 

Another aspect of ratings which interested the wiitoi was the 
comparative unifoimity of latings of specific behaviors and of gea- 
eralized traits Ratings weie obtained on but two such traits, as 
follows: 

1 Degree to winch each toy waa an acceptable member to those of his own 
tent group. 

2 Degree to wlucb each boy was an acceptable membor to the inajoiity ot the 
tluitj' boys in camp 

Ratings were made on a scale similar to that used m the specific 
behavioi ratings, and the moan SD for each trait was sunilarly cal- 
culated. The menu SD's were, respectively, 6705 and 6520, foi the 
above traits The self-coi relations were 885 and 655 respectively, 
'While these results are not significantly different from these shown m 
Table II, they show comparatively high uniformity, and further meas- 
uring of other tiaits might havo shown a tendency to rate traits more 
uniformly. It is to be regretted that moio data wore not obtained 
at this point. 

In the above calculations the degiee of certainty which was indi- 
cated along with the numerical values foi the ratings, has not been 
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considered. Would the icsults have been different if the numencnl 
values had been weighted according to the degree of certainty? 

Table HI levcals sui prising differences in certainty among the 
jgix groups of behaviors. There is a steadily deci easing certainty 
from Group I to Gioup VI The calculations shown in Table III 
were made by finding the algebraic sum of the number of boys rated 
with certainty (maiked plus) and the number of boys rated with 
uncertainty (maiked minus) for each behavior. 

Now, with such decided diffeiences in the certainty of the ratings 
for the various groups of behaviois, one might expect to find signifi- 
cant differences in uniformity of lating if ccitamty is taken into 


Tatilb III — Deqube op Cektainty of Ratings fou Each Behavior 


Gioup I 

Gioup 11 

Group III 

Behavior 

number 

Cci fcninty 

Boluivioi 

niimbei 

Cei tainty 

Behavior 

number 

Coi tainty 

6 

41 

1 

18 

2 

-2 

7 

11 

3 

27 

11 

12 

13 

46 

18 

10 

17 

29 

16 

64 

20 

24 

21 

4 

27 

37 

24 

40 

23 

38 

Mean 

37 8 

Mean 

26 0 

Mean 

17 0 

Group IV 

1 Gioup V 

Group VI 

10 

9 

4 

-6 

6 

-23 

12 

23 

8 

-11 

9 

-42 

14 

32 

20 

16 

16 1 

-10 

19 

20 

29 

37 1 

25 

-22 

22 

19 


- 3 

28 1 

-10 

Mean 


Mean 

6 0 

Mean j 

-21 4 


account Calculations weie tlieieforc made according to the following 
system of weighting: Ratings marked certain were weighted three 
times; those marked neithei ceitam nor unceitain weie weighted 
twice, and those unceitain, once 

Behavior No 9 was rated with less certainty than any other 
behavior. Its mean SD as given in Table II is 7096. As lecalculated 
according to the above weighting, the mean SD is ,6966 — a negligible 
difference. 
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BehaAHor No. 15 was ralcd wUh Ihc, most certainty The weighted 
mean SD is .6042; the weighted mean SD is .6552, again a negligible 
difference 

A third calculation was made, chosen at random, The mean 
unweighted SD for behavior No 1 is .7065; weighted, 7067 — prac- 
tically identical. It was thercfoic not thought worth while to recalcu- 
late the other behaviors, since the differences are oiivioualy insignificant. 

The failuie of this factor of ccitainty to lender more uniform the 
calculations may be explained by a fuitbci con elation The relation 
between certainty and nniforimty (ns mcasiiicd by the moan SD) is 
— 0015 This means, of course, that raters dificicd as much among 
themselves when fairly ccitain as when unccitain The only con- 
clusion to be drawn from the estimates of ceitninty, then, is that 
they tended to confirm the basis on which the six gioups of behaviors 
wcie chosen. The cxpciimentci was ovidcnlly fairly successful in 
choosing those behaviors which should bo rated with the most and the 
least certainty. The only diificulty was that certainty and uniformity 
had little or nothing to do with each othci 

IV 

Some light may be thrown on possible reasons for these i oaults by 
again vofevring to the study of the first summer. The twenty-six 
behaviors thou raensurod weie chosen as being classifiable under some 
one of nine trails supposedly indicative of intvovoraion-extrovcision, 
Intercorrelations of all bchaviois grouped under a given trait were 
calculated for both sets of data, i.e , ratings and objective records 
The moan intcrcorrclation of these one hundred twelve intia-trait 
behaviors, according to the latings, was .493 ± .093, the moan of 
the same one hundred twelve intercorrelations, according to the 
objeotivo leeords, was .141 ± .121 The conclusion may theiefoic 
be drawn that the halo effect, inevitable in the ratings, worked m 
such a way as to cause the rater to rate similaily logically related 
behaviors such as those classifiable under a single tinit The close 
lelation between the intra-tiait behaviois which is evident in the 
ratings may, therefoie, bo presumed to spring from logical picsupposi- 
tions in the minds of the raters, latbor than from actual behaviors. 

This hypothesis helps to account for the faihne of the fiequciitly 
observed behaviors to be rated more unifoimly than those rarely 
observed, or those never observed at all There is, of couise, one 
other possibility — that the frequently observed behaviors nie, indeed, 
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accurately rated and that, by nifciriiiK fiom fanuluu bohaviois, the 
imagined situations aie rated with equal accuracy To lake this 
latter position, however, is equivalent, to saying that lieluiviors may 
be accurately rated by guessing at them when they have ncvei been 
obsoivecl Few psychologists will be willing to concedi' this It 
seems a truer statement to say that oven with ample oppoitiiiuty for 
obsciving, the ratings weio little oi no bettor than guesses. 

The icsults of the study of degiec of certiuiity tend to confum 
this view. Rnteis agreed no more closely when fiuily ccilaiii than 
when uncertain. The water venluica a suggestion as to why Lins was 
true Assuming, as above, that the halo effect was at woik almost 
equally in lating oliserved and unobserved behaviors (since the latter 
weic as unifoiinly laled as the foimor), in the case of the foimer the 
raters weie able to iccall inckienls supporting Ihoir "Imlo-med" 
impression— conveniently foi getting, of course, the incidents which 
did not support this impiossion Such rating.? weic Ihereforn marked 
certain In the case of the unobserved behaviors no such mcideuts 
could be called up, the impression lenuuned, but cniild not lie factually 
supported, and was therefore marked unoeiLain That the ralcre 
agreed to a considerable degree indicatos that (.heir halos coincidcil to 
some extent That they differed indicates that each lalei had his 
own private halo. 

The writer concludes, thoiefoic, that under those conditions, 
appaiently optimum for rating purjxisc.s, ratings on spocifio hchiiviois 
were so largely colored by the Burrounding halo as to lie quite invalid. 
Neither hequent obseivation of the behavior being rated, fioquent 
recording of it, iioi weighliiig the scoies in accoi dance with the dogicc 
of the ratei’s ceitainty had an appreciable effect on umfonnity of 
rating Behaviors never lecoided, never seen, and those felt to be 
highly uncertain weic as uniformly lated ns those at the opposite 
extremes Since the guessed rulings aie of highly questionable valid- 
ity, must not the otheis, which aic no more uniform, bo almost equally 
invalid"? 



A METHOD FOR JUD{HN(; THE DISCRIMINATION OP 
INDIVIDIIAI. QUESTIONS ON 'rRIIE-FALSE 
EXAMINATIONS' 

C. H WHEI-DEN, JH AND F J J DAVIES 
Yiilc Diiivetuitj 
I iNTHODirCTION 

The following introcUioloiy comment on the scoring of true-false 
examinations is merely for the purpose of making cleaier some of the 
later portions of this article It is generally rocogmacd that whatever 
othci method of acoimg a true-false examination may be used, the 
method of scoring by the total of right answers is not satisfactory. 
If the number of questions is at all large, a man would be apt to get 
half his answers coricct by slieci guessing, 

A number of methods of scoiing designed to eliminate the effects 
of guessing arc possible, and the method adopled for any given case 
will depend upon the particular condi lions of that case One such 
method is the following, which was adopted at the Yale Law School 
for its true-false examinations. PioUminary warning is given that 
guessing will bo penalized, that if an answer has to be guessed it had 
bettei be omitted entirely. The examination is scored by adding the 
sum of omitted answers to twice the sum of wrong answcis. The 
lowest score is then best and the highest is worst. The theory under- 
lying the method is that guessing will bo greatly minimized if not 
entirely eliminated, and that simple lack of infoimation on a given 
question is not to bo scored against so heavily as dofimtoly wrong 
information on that question. 

The minimizing of guessing thiough the preliminary warning seems 
to be accomplished. A brief investigation has given abou t as certain 
an indication of that result as is possible Out of seven examinations 
given in June, 1928 it was found on all but one that the group of men 
with the highest average law grades for the year (the lop third of the 
group taking any one examination) had a smaller proportion of then 
examination scores aoooimted for by omitted answers than did the 
group of men with the lowest average law grades for Ihc year (the 
bottom third of the group taking any one examination). On the sixth 

' The aubaUnoc of a lopott prcpaicd for the Yalo Liiw School and the Depait- 
mont of PcTsonncl Studj of Yale Uiuversitv 
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examination, as they are listed in Table I, the propoi Uon ran slightly 
the other way but not sufficiently so to destroy the significance of the 
evidence given by the other six The indication might be taken to 
be that the best men guessed more than the poorest men. Logically 
the poorest men would be expected to do the most guessing, as anyone 
with much to gain and little to lose by taking a chance is most apt to 
take the chance The indication, therefore, is rather that guessing 
was so well minimized that the pooiost men did not reveal their 
relatively greater propensity in that dncction and that the best men, 
not lealizing their own limitations so clearly as the poorest, gave 
evidence of incorrect information where the pooiest men admitted 
lack of all information. (See Table I ) 

One of the chief objects of a true-false examination and of its 
scoring, as in the case of any examination, is, of course, to discriminate 
adequately between men of different ability. A true-false examination 
correctly scored may give such discrimination fairly well, but at the 


Table I, — Tina Peucentaoes of Totai^ Giioup Scores Dud to Wrokq Answers 
AND TO Omitted Answers on Seven True-false Examinations, Yale 
Law School, June, 102S 


Course 

Group Xj top thud of tho 
mem taking each oxami- 
nntion — according to then 
law grades for year 

Group Zj bottom third of 
men taking each exami- 
nation — nccoiding to their 
law grades for year 

For cent of total score duo to 

Per cent of total ecore due to 

Wioiig ^ 
answers 

1 

Omitted ^ 
answers 

i 

Wvon^ 

answers 

Omitted 

answers 

1 

88.3 

11 7 

84 7 

16 3 

II 

94 2 

5 8 

90 9 

9 1 

111 

93 8 

6 7 

92 9 

8 1 

IV 

92 8 

7 2 

92 4 

7 e 

V 

94 0 

5 4 

91 7 

8 3 

VI 

96 0 

4 0 

90 6 

3 4 

VII 

94 0 

6 0 

00 8 

0 2 

Seven exam mat lona 

93 4 

6 6 

91 3 

8 7 


Note — The table la designed for the comparison of Group X with Group Z 
If tho table is used for a compaiison of wrong answer percentage with omitted 
answer percentage within either group, it should be remembered that wrong 
aaftwers arc multi phed by two before going into tho total score 
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sartio time ccitain questions on the c'vuminiition iniiy give it much more 
adequately than others A question, for example, may contain some 
subtle ambiguity which will thsliacl tlie belter men but will not 
trouble the poorer men at all, anotbei may lie so diflicull that only 
the exceptional man can answer il conectly Avhile all others fail to 
comprehend it regardless of the varying degiees of their actual ability, 
Another question may be bo simple or fundtiinenlal as to be answerablo 
by practically anyone who has been expohocl to the subjccl-inattcr 

In Older that tmc-falso examinations may be impiovcd m con- 
struction so as to discjiinmalc inoio adequately between men, it is 
unpoiLant that a method sliall be available for judging the relative 
power of discriniinalion of the dilToicnt questions whicli have been 
included in such examinations in the past. As a preliminary to the 
development of any such method it should bo iccognizcd that wheiever 
possible the basis for the judgment on the individual quc-sLions should 
be the same ns the basis selected as coircct for the scoring of the exami- 
nation. The discrimination given by the exainiimtion ns a whole 
18 only the net result of the discrimination given by the individual 
questions. 

II. Tiieoky 

If the 1 dative fibililies of men in the general field under examination 
can be determined indcpendonlly of the specific examination which 
is to be judged, it can be said that blie examination, if it discriminates 
coMcctly, should give those men scores winch will vary in accordance 
with the independently deteunincd measures of their respective 
abilities; such scoies may bo culled Staiidiutl Examination Scores. 
Tor the sake of initial simplicity in exposition, in spito of the criticism 
already made of scoiing by the lolal of light answers, consider the 
case of an examination of one hundred qiicalions scored on the basis of 
total right answers, but with guessing supposed to he non-existent. 

Suppose that the examination is so perfectly disci imma ting as to 
give a fecoic of 80 to any man whose independently raeusuicd ability 
m the field is 80 on a scale of 100 Suppose there are one liuiulied 
such men, Each one will have given the right nnswei to eighty ques- 
tions. If all the questions are of exactly equal caliber, not all the 
one hundred men will have given the i ight answer on any one question 
or the wrong answer on any one question. By definition the questions 
are of equal caliber In the hands of this gioup of men of equal ability 
each question will consequently be answered light by eighty men and 
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wrong by twenty men, that is, the standard man-scoie pei question 
will be 80 on the basis of right-answoi scoring 

Similaily, if there is anothci group of one hundred men, each of 
’ whom has an independently mensuied ability of 60 on a scale of 100, 
each one of the one hundred questions of equal caliber will be answered 
right by sixty men in this gi oup. If the men in the first group obtained 
scores of 60 instead of 80 and the men in the second group scoies of 45 
instead of 60 (that is, if in the first group each question was answered 
light by sixty men and m the second group each question was answered 
right by forty-five men) the examination would have been one of 
gi eater difficulty, but each question, as well as the examination as a 
whole, would still be disoiiminatmg ooueotly between the men of 
the two grades of ability The men of the second group are still 
shown as possessing three-fourths as much ability as the men of the 
first group, 

If one question, however, is answered right by eighty men in the 
first group and by eighty men in the second group, it does not dis- 
criminate between the two grades of ability. If all the questions were 
of the same caliber and gave this result, the score of each of the two 
hundred men on the examination would be 80 and the examination 
would not be discriminating as between the two groups of men of 
different ability* Similarly, if a question is answered right by eighty 
men in the first gioup and only forty men in the second, the question 
18 over-discriminating, If a question is answered right by forty men 
in the first group and eighty in the second, th-e question gives reverse 
discrimination 

Go back to the case of perfect disciimination by each question 
If there had been fifty instead of one hundred men in each of the 
two groups, the number getting each question right would obviously 
have been for each group one-half of the number found in the case 
of one hundred men to a gi oup. If, on the other hand, there had been 
two hundred instead of one hundred questions on the examination, 
if all obhei conditions and assumptions lemain the same, the exami- 
nation score of an 80 man would have been 16-0, and the score of a GO 
man, 120, If m this latter case there me also two bundled men in 
each group, each question will be answered right by one hundred sixty 
men of the first group and by one hundred twenty men of the second 
group. 

Whatevei the standard examination score is for a gioup of men of 
given ability as independently measured, the number of men in the 
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gioup which will get vight each one of tlic sot of perfectly discriminating 
questions of average dilTiculty is given by the piodiict of the standard 
scoie and the latio of the numbei of men in the group to the number 
of questions on the examination If the numbei of men of given 
abilit 5 ' in one group is fifty and the mimbev of quoslions is two hundred, 
the standard score foi the men of that group being, say, 160, the 
number of men getting each such perfect question light will be (160 X 
that IS, 40. This relationship must be used to i educe the 
standard qucstion-scoro per man to the stnnclurcl maii'score per ques- 
tion, that IS, to leducc the atandaul examination score to what is 
hereafter called the standard conected cxiuiuniilion score 

Not all the questions wiU be simply of aveiage difliculty. One viiU 
be slightly more difiioult, another slightly leas, but they may still 
discnminaie correctly between the giiulca of independently measured 
ability In order to judge quickly the degree of discrimination shown 
by any question, it will be convenient to pxpics.s the standard man- 
scores per question as ratios of one unolher. If, for example, the 
standard cmrccted score for a group of men of 80 ability is 30 and for 
a group of men of 60 ability is 15, the lalio of the scoic foi the first 
group to the score foi the second is 2 00. Then if on a given question 
twenty men of the first group and ten men of the second answer 
coneclly, although the jcspcctivc scoies arc not the atandaul corrected 
scores, it is at once clear that the question still discriminates coneotly 
between the two groups, for tlio ratio of the scores made on the question 
is 2.00, 

When tho whole number of men taking an examination la divided 
into groups according to their independently measuicd abilities in the 
field (three such groups will generally be advisable foi the pui poses 
of the later judging of the questions), it will raicly, if cvci, happen that 
all the men in any one such group will have the same independent 
measure of ability. The grades taken as measuring this general 
ability will vary within each gioup. Tho independent measure of 
ability for each group of men as a whole will be the aveiage of their 
individual measmes Coriclahvc with this average for the group 
there will be an average standard oxamuiation score in place of tho 
single definite standaid examination score implied by the discussion 
which has preceded. 

The fact that the standard score foi each gioup is in the natuie 
of an aveiage taken {lom variable Dieft&vucs rcquiica another modifi- 
cation in the criteria nsed foi judging the discummation of the indi- 



Tiue-false Examinations 


296 


vidual questions. Allowance must be made for the existence of 
variability within eacli group, for ifc mtioduces the probability of 
chance-fluctuations in any mcnsuies of the operations of the group 
The piaotically ceitain limits of variability within any group, which 
docs not depait too far from normal m its cUsliibution, is given by the 
range of three times the sigma (Slandaid Deviation) of the group 
above and below the anthmelie average of the group The sigma 
of the independent measures of ability for each gioup must be found, 
and then translated, in the foim of a percentage of the mean fiom 
which it is calculated, to terms of Bliindaid examination score, just as 
the aveiage independent measure of ability is to be found and trans- 
lated; the process of tins translation will be described m detail. The 
translated average and the translated 3-Bigraa lange give a standard 
range of corrected examination scoics foi each group. 

For example, a group of men witli average independently measured 
ability of 80 may liave a standard range of corrected examination 
scores of 60 to 40; and a group whoso independent average is 60, a 
range of 30 to 20 Ilospective scoics on a given question which fall 
within these ranges will now be tlie index of a correctly disci immating 
question The actual scores might be GO and 20 icspeotively oi 40 
and 30 respectively. Either pair of scores must be taken as indicating 
correct discrimination since the two scores of oaoli pair aie within their 
respective 3-sigma limits of variation. 

To keep the advantage of having latios between scoics, instead of a 
comparison between the scores themselves, for judging the degree of 
discrimination shown by a question, the limiting scores for the groups 
may be expicsscd as latios of one another (the upper limit of one 
group as a ratio of the lowei limit of another, and the lowci limit of 
the first as a ratio of the upper limit of the second). The result is a 
range of ratios, instead of a single latio, to be used as the ciiterion for 
discrimination. In the example last given, the range of ratios for 
criterion is ^%o to or 3,00 to 1 33 

The same theory and method apply whatever the system used 
for scoring the true-false cxamiiialion In the case of tiro Yale Law 
School examinations to wliicli the method has been applied the system 
of scoring, as explained before, was twice llic sum of wiong answcis 
plus the sum of omitted answer b. The tiausition fiom question-scoie 
per man to man-score pci question follows heie just a.? it does in the 
case, used puicly for illustrative purposes, where scoimg is by the 
total of right answers The question is always scoied by the system 
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winch is usGcl to ficoie a man on the whole cxiuninatiou, In this case, 
therefore, each answei is scoiccl for each of the groups of men by twice 
the sum of the men getting it wrong phis the sum of the men omitting 
it The Ihcoiy no longer says, ns in the case of the preceding illustra- 
tions, that of II gtoup of men, all of 80 nbilily as indcpenclently meas- 
ured, 160, say, if that is the standard corrected score for the gioiip, 
will give the light answer on each of a set ot qucstiona of average 
diHicully and coirect discnminiilion. It siiya instead that the men of 
such a gioup will on such a set of questions of equal cnlibei give the 
right answci to one question just as frequently as to nny other, will 
give the wrong answer to one quostion just as frequently ns to any 
othei, and will omit one question just as frequently as any other. 
The fieqiiency of answeiuig riglit, nnsweiiiig wrong, and omitting to 
nnswoi depends upon the level of ability of the men in the group 
The Iheoiy says, iii other words, that the man-score per question lu 
such a case "Will be the standard coriected evammation score, all 
scoring being by a eommon system. 

The one important point so far omitted from consideiation is the 
matter of transition from the independently dctoi mined measures of 
ability in the field to the scores on a particular examination, In 
speaking of independently determined mcu8urc.s the meaning is simply 
that such measures must not be determined solely or primarily from 
the results of the examination of which the questions aie to bo judged 
for discrimination. 

In the case of the Yale Law Soliool true-false examinations the 
independent measure of ability of a man was simply his avciage Inw 
grade for the year. Such a grade was felt to be sufficiently inde- 
pendent of a man's showing on any one tiuc-false examination to 
which the method of judging quc.sfcion8 might bo applied. The man’s 
law grade for the year is the average of all his grades in all liis courses 
Geneially a man would take about five courses and m approximately 
three of these, as the general case, would be given a true-false exami- 
nation. Almost without exception such a tiuo-false examination 
would not stand alone in the course but would bo supplementary 
to a written examination of the usual type. A man’s showing on 
any one true-false examination in any one course is, therefore, but 
a small part of his avevago law grade for the year m nil couisos. Such 
average year grades are not, of couieo, precise measures of ability m 
the field of law Such gi-ades, however, and it ia the only important 
point m this connection, will be as good a reflection of the relative 
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diffei cnees m ability of a group of men as ia possible with anything so 
arbitrary in natuie as an academic giacle. 

The connection between the independently determined measures 
of ability and the scoring of the given examination of which the ques- 
tions are to be judged for disci imination may be made by a simple 
transmutation* A generally satisfactory method of making the 
transmutation for those scores which aio necessary m the establish- 
ment of cuierm for the judging of questions, without my waste of 
time over those scores which are not necessary for the purpose, may be 
illustiated by the proceduie followed in the case of the Yale Law 
School examinations, 

The average oi year-grades of all law students foi the year con- 
cerned aie tabulated m a frequency senes and cumulated downward 
from the higher giades On the examination to be judged the scores 
arc similarly tabulated and cumulated downward from the lower 
scores, since on the system of scoring used a low score means a better 
showing than does a high score Suppose theie are three hundred 
men represented m the general distribution of year-giades and ninety 
in the distribution of the scores on the particular examination The 
ninety men taking the examination have been divided into three 
gioups of equal size accoidmg to their year-grades Suppose that 
one of these groups has an average of SO in year-grades In the 
general distiibution of yeai -grades there is found the percentage of 
the three hundred men. with grades of 80 oi higher In the distribution 
of examination scoies this same percentage of the ninety men there 
included will have attained or exceeded a certain score (exceeded here 
in the sense of getting a lower score). This seoie is the transmuted 
equivalent of the eighty m year-grades. When this score is multi- 
plied by the ratio of the number of men in the particular group (30 
in this case) to the number of questions on the examination, the product 
IS the average standard corrected examination score for the group 
The calculation of the 3-sigma range of variation follows directly at 
this point, m accordance with the method alieady indicated and 
explained more precisely in the section on Procedure 

This method of tiansmutation assumes only that grades or scores 
on any one examination of any kind m the Law School will tend to 
follow in their actual significance a distribution which will be fairly 
uniform with the distribution of final yeai -giades given to the students 
in the school The assumption is one of aimilanty and not of coinci- 
dence So long as the particular examination is intended for no 
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unusual pm pose but simply for the cuatoniary testing of relativo 
abilities, and so long aa the number of cases in the distributions of 
grades and scores is fairly large, the nsaumption seems juatifled. 

The rules for piactical judging of the questions, as well as the 
exact method of establishing the criteria for judgment, are given in 
the section on Procedure. The language of this section, which follows 
shortly, applies spcoiiicftlly to the Yale Law School oxammations but is 
easily generalized The actual rules find thciv promise in the under- 
‘lying theory of the system, as that theoiy has boon aumraaiized here, 
but they have modified and developed out of practical experience in 
judging questions on seven true-false examinations given m the Yalo 
Law School in Juno, 1928 No new modifications of these rules wore 
found nccessaiy when tlio syslom was applied to other examinations 
given in the school in Febiuaiy, 1928 and in Fcbiuary and June, 1929, 
but they should be considered as still open to modification as more 
exporionce with the system is gained. As given in the section on 
Proccduic the rules aio for the most part self-explanatory 

A tost has been made of the validity of the results obtained in the 
application of tins system of judgment to true-false examinations 
given at the Yale Law School between 1028 and June, 1929. The test 
consisted in a sorics of linear conclations between average law grades 
and the true-false examination scores. 

It should be remembered that the object of the system of judgment 
is to classify the questions according to the natuic of the discrimination 
they tend to show as between students of diffcicnt abilities. The 
standaid for judging such discrimination by the questions is baaed 
on the ilisonmmabion actually made between students by then law 
grades. Thus, if the judgments given, by the system are conect, the 
scores made on an examination composed entirely of dtscrimmaling 
and over-discnmtnahng questions would have a high degree of positive 
correlation with the law giades of the men taking the examination; 
those made on an examination conaposed entirely of non-dtscrinnnating 
questions would have a very low coirclalion; those made on an exami- 
nation composed entirely of revet sely discntmnaiing questions would 
have a negative correlation 

The test, in its particular form, was auggestod by Mi Paul W 
Burnham of the Department of Personnel Study at Yale The results 
of the test are given m Table II. It will be obscivod that throughout 
the eleven oxammations listed in the test tiic correlations of law grades 
with the actual examination scores arc lower than the conelntions of 
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law grades with the scores which would have been obtained if each 
examination had consisted only of its discriminating and over-dis~ 
criminating questions, and that those latter correlations in themselves 
are positive and relatively high. It will be observed, further, that the 
correlations of law grades with the scoies winch would have been 
obtained if each examination had consisted only of its no?i-discrimi- 
naling questions aro in still another categoiy of distinctly low degree, 
and that the correlations of law grades with scores based entirely on 


Table II — Coiuiblationb between Average Law Grades and Thtje-palsb 
Examination Scores, for Eleven Examinations Given at Yale Law 

School, 192S-1929 


Examination 

Coefficients of con elation 

Law gmdes 
With actual 
examination 

scoics 

Law gmdes with c^Lamination scores that would 
have been obtained if examination had consisted 
entirely of its — 

Discummating 
and over- 
discummating 
questions 

Non- 

disc nminatmg 
questions 

Reveisely 
disci imina ting 
questions 

I 

71 

81 

29 

- 26 

II 

82 

1 87 

40 

“ 27 

III 


1 78 

41 

- 36 

IV 


1 09 

20 

~ 24 

V 


1 84 

29 

- 36 

VI 


i 58 

40 

- 08 

VII 


72 

10 

“ 31 

VIII 


i 76 

12 

- 63 

IX 


81 

- 02 

- 64 

X 


! 67 

28 

- 24 

XI 


71 

36 

- 48 


Note — Coefficients are positive except where indicated as negative 


reversely discriminating questions are uniformly negative The degiee 
of success in the application of the system obviously vanes fiom 
examination to examination, but shows a maiked variation downward 
m only one of the eleven examinations tested (number VI as they are 
given in Table II) The correlations obtained are such as appaiently 
to establish the validity of the judgments. 
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III, Phockimjhij 

The following Hie iiihtructionfl for judging questions on Irue-false 
exHinmations of Yale Law School. Lach numbered paragraph la 
hereinafter referred to aa a seetion, 

[, On eacli pxanimation j)ai)or for a givni ovnmiimtion plnoc the flluclcat^a law 
grade (avciago grade for vear in ah oonraes) m the inthipendenl incasuro of pio 
atvidonVa ability > 

2 Por the givon rxEiiinimtion gioup make a (Intiiliulion plot of llio law gradcsi by 
tenths of per cent (Form 1) 

3 Piom Porm 1 cUvulc the exam mat ion into thico mih-gioups accord mg to law 
grade, each sub-group coutammg tho same number of students Gall tliese 
three gioups, in descending ordci of law guule, A", T, and Zj lespcctivcly 
Note — Should the oxamiiiation group not l)o exactly divisible by thieo, it will 

be necessary to omit one oi two eases taken from tlic middle of the gmiip, such cases 
to bo gkvon no further conBulcintiou, 

4. Accoidiiig to the division dotoimmoil in section 3, soit the examination papers 
mto tho three siib-gioups Y, T, and Z, 

6 Tabulate law grades for ench auli-giouj) A", V, and Z, usuig class-mtorvnt of one 
per cent (ITorm 2). 

0 Plot separately for each of tho siih-gioups V, F, and Z tlio wioiig answers nnd 
tho omissions on oacii quostiou m the cxaminatiOH (Foun 3) 

7* From Form 3 transfer to the icspcctive columns A, V, 2, and T'otal on Form 4 
the scores oC each qiioation, 

Note — Tho scoio is to he calculated hy using the same linsis ns that used by 
tho Law School foi scoiing a student’s examination paper, c p , in June, 1928 the 
student’s scoie was given by Iwiro the sum of his wrong answeis plus tho sum of ]m 
omitted answors 

8 Tabulate the average law grades last loporlod by tho Law School for nil 
etudeiits in tho school, using a clasa-mterval of one per cent Then cuiniilato 
downward from tlio high grades (Form 5) 

9. Tabulate tho scores on the glYcn cxaininalion (sub-gioups A', 1% and Z com- 
bined), using a clftss-iiitorval of one point Then cumulate downward from 
tho low scores (Form 0), 

10 From Form 2 calculate tho arithmetic mean nnd ‘’sigma” of law grades for 
each sub-group X, F, and Z, 

U For each fiub-group X, Y, nnd Z use the following pioce<iuie 

(a) Take tho sub-group mean law grade as found m Boctioii 10 and find in the 
cumulative diatrdiution column of Foim B tho nunibci of studenh having 
that or a higher giadc. Express tlua number as a poicentago of the total 
number of stiidoiits, le ^ of N on Foini 6 
(&) Apply this poicentago to the uiimbor of Hfciuloiits in the oxainiiiation under 
review, i.e,, N on Foim 0; in tho cumulative distribution of Foiin 0 locate 
the figure so gained and read tho corrcBponding Bcorc \n iUe examination 
score column of the same Form This scoio is tho average siauda^d emin- 
inatioTir score for the group 
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(c) MiilUply this aveiage staiulaid e\ aim nation scoic liy tho latio 
Numbe r of a tn dents m sub-group (Xy or Z) 

Number of questions on examination 

Tho icsiilt IS the average tilamla}d corrected cxaintnalwn score iQ\ the gioup. 
{d) Multiply this ftveiage stanclaul collected examination scoie by the ratio 
biging (ns found in section 10) 
inoaii (ns found in section 10) 

The losiilt IS the standard conected scojp value of the sigma-vanation for the 
gioiip 

(c) Three times this staiidaid collected scene value of the sigma-vanation 
(just found in d) added to and subtracted fioni the aveiage standard cor- 
icctcd examination scoig (found in c) give's the standard range of scores for 
the gioup 

12, List the staiidaid langc of scoies foi the thiec sub-gioups on Form 4 and expreaa 
them as ratios, thus* 

X Vpper h mit oF X Lower hmtb of X 

Y Lower hrait^f T Upper limit of Y 

y Upper lim it of Y Lower li mit of_y 

Z Lower limit of Z ^ Upper limit of Z 

X Upper li mit of X Ij OWCi limit of X 

Z Lo^Ye^ limit of Z Uppei limit of Z 

13 Grade as N (see section 16 below) dhose questions which have in each sub-gioup 
Xf 7, and Z scoiea le&s than the lower limit of the standaid lange of ^coies for 
aub-gioup X as found in section 11c 

Note. — If a question is so easy that in each sub -gioup the scoie is less than 
would noun ally be expected jn oven the host sub -gioup, it is obviously a non-dis- 
criminatiiig question If a question is difRcult and in all sub-gioupa only a vciy 
few men get it right, it is advisable to apply the tests for discnmination given below, 
since It 13 moie in the natuic of a diflicult question to be disGiimmatmg 

14 Foi all lemaining questions fill in the latio columns on Foim 4 aa follows’ 
Calculate and entci the X/Z ratios, calculate and entei eithci the X/Y latios 
01 the Y/Z ratios, whichevei has the smallci upper limit in the Standaid Ratio 
Ranges (as found m section 12 and hated on Foi in 4) In calculating these 
latios consiclei a zoi o scoi e as a scoi e of one X/ Y will noi in ally be the second 
ratio used 

Note — Two latios foi the queationa me aiiflicient foi giadmg purposes, the 
thud latio, when necessniy, being determined by the i elation between the othei 
two, thus. Y/Z equals X/Z divided by X/Y, and X/Y equals X/Z divided by 
Y/Z, Assuming foi the moment faiily noimal dialiibutions within each sub- 
group j the Y/Z standaid latio langc will have a smallci uppoi limit tlian the X/7 
standard ratio mngc if the mean law giade of sub-gioiip Z is fnithcr below the mean 
of sub-gioup 7 than the mean of siib-gioup Y is below the mean of aub-gioup X 
That IS, the Y /7j latio will be used in picfcrence to the X/Y latio if tho Z gioup 
shows gi enter diveigence fioin tho 7 gioup than tho 7 gioup shows fiom the X 
group If the suh-group dish ibuhons are highly ahnot mat so that the S-sigmn ranges 
overlap badly, the system will be applicable only after extensive modificaiionf if at all 
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15 Ciradc nccoulmg to lh<' wUcri the vcnm\v\»\R qucHtion^ on Foim 4, i e, 

those (lucRtions not graded N under Rectiaii 13 

(rt) Grade n<t AT (eco sreticm 10 below)" 

(1) Quostions with X/Z inlio gieuloi tlinn 1, Init the tolnl scoic of the 
question is less llian tliiee tunes the lowei limit of tho Standard linage 
of Scoica for siib-Kioup A’ as found m neclion lU 

Hotei— I kr 18 fclb UIUHHO to label a question Uever«al iiifltead of Noii-diBcnm* 
(oi OvoMlwftvuuvnnUng msleiul ut Buuply lbsciui\iimUn}T) unless tho 
quegtm 18 of suck difFicuUv tluvl iUc total aeoie foi uU tluee aiili-gioups is at Icnat 
equal to throo tunes tho lowest eeoie noun ally ox pee led in tlio best sirb-group^ 

(2) Questions with X/Z lalio equal to i, oi between 1 and the uppoi limit 
of tho X/Z Standard Ratio Range ns found m section 12 

(6) Grade /? (flco socUon 10 l)cbw) (Jiiestions with X/Z latio gientor than 
1, and the lotnl scoie of the quesHon la eiiiial to or more than three timeg 
the lower huwt of the stamlard u\uge of scoies for suh-gioup X i\s found m 
ficobion lie 

(c) Grade an 0 (see section 10 below) Questions satisfying all tho followiDg 
roqiiiromeulfj* 

(1) X/Z ratio less tliiiii the knvei hunt of ita staiulaid lango as found m 
section 12, and 

(2) X/Y ratio (or 1 /Z ratio, whirhesor in used m dotermincd in section 
Id) less than tho lower hunt of its fltuudurcl range i\a found m section 12, 
and 

(8) The third latio no gioatcr timn the upper limit of Us standard mnge ds 
found in flection 12, and 

(4) Total flcorc for the question equal to or moio tlmu three times the lower 
limit of the alnndard raiigo of scoios for su)3-gioup X as found in sec 
tion lU 

(d) Grade as 1 ) (pee section W below) ‘ 

(1) Questions that satisfy roquiromeiit (1) foi an 0 (picstion (in pningiaph 
c just above) but do not Hatisfv one or nioic of Iho other lequiicmqnU 
for an 0 question 

(2) Questions with the X/Z ratio withiu the Imuts of \ h standaid lango as 
found in section 12 

16. Defmitiona of classes of judgment’ 

N Questions that do not discrimmato between aub-groupa Each sub-group 
tends to react similnilv to such question*!, making the qucstionfl of no value as a 
test of comparative ability between higlmr and lower sub-groups 

Questions which diacrdiiinate inversely between suli-gioupH In such ca-aca 
students with tho higher law giaclos obtain poorer results than do students witli 
the lower law giadea 

0 Questions that d!aeummn.to boUveen hub-guuipa to ii grcatei extent tluui 
IS justifiocl by tho leiativo lovcla of law grades 

D Questions tliafc make normal discrimination bcfcwisui fiub’gioups 
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1 Dibthibution Plot of Year Law Grades for Students Taking 
True-false Examination in . , June 1028 



NB — The solid lines maik the division into tliiep groups A", F, and 
containing 31 cases, 

^ The two cases at the middle of tho distnbution which are omitted from 
all further consideration, making the whole gioup exactly divisible into three 
aub -groups, 
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2 — CiKOl^r DlRTIllT^A^TlO^iB OV Yv.\U li^W VOW KTUDlSNTfl TaKIS^q 

TnuE-FALRB Examination in , , Junu 1028 


Oroup -Y 


(lioup y 


(jioup Z 


Gi ftde 

Nuinbpi of 
Btudauts 

(iMull- 

Niiiphcr of 
aludojiU 

Ciiado 

Number ef 
stnciciils 

81 

1 

73 

1 

07 

u 

3 

2 

2 

5 

0 

fi 

2 

1 

1 

ft 

r> 

^ 6 

1 

1 

7ft 

3 

4 

4 

SO 

1 

09 

y 1 

3 

3 

79 

I 

8 

7 

2 1 

2 

8 

7 


— 


— . 

7 

3 

'rouii 

31 

'L'olal 

31 

6 

4 

1 




6 1 

4 





4 ■ 

2 





3 ' 

4 


1 



Total 

31 






PonM a.— CiiBGK Lift’r> hv Q^KRTiONkn, OF Nombku op Stoountr in Each Sto- 
Gnour A"', K> and Z ANswnniNo WiiCNO oit Omitting Anhwcii, on TnuB- 
PALBB BlXAMlNATION IN . ► , JUNl) 1028 



Group Y 

Group Y 

Group Z 

Question 


1 





Wrong 

Omittofl 

' Wrong 

Oinittod 

Wrong 

Omitted 

nurabci- 


1 answer 

i nnswoi 

1 

1 auRwor 

answfv 

ftuawor 

auBwet 

1 

0 

0 





2 ' 

12 

2 





3 

u 

3 


(simdaily) 


4 

5 

0 





5 

11 

7 





ft 

3 

8 





Etc 

Etc. 
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FonM 4 , — Judging Chitbuia, Scohbs, Ratios, and Question Grades if or 


True-palbh Examination in , * » , June 192S 


Sub-group 

Standard range of 
scores 

Standard ratio 
ranges 

Score criterion 

X 


10-13 

! 

X/Y, 

81- 53 

Foi N Each sub- 

Y 


16-19 


YIZ, 

00^ 67 

group score 9 or 

Z 


21-24 


xiz, 

62- 42 

less. 








For R and V ; Total 








score 30 or more 

Question 

Score 

1 

Ratio 

Question grade 

number 

X 

Y 



X/Y 

■9 

1 

0 

; ^ 

4 

7 


■n 

N 

2 

26 

23 

30 

70 

1 13 


N 

3 

31 

39 

33 

103 

79 


N 

4 

10 

20 

23 

58 

50 


D 

6 

20 

31 

30 

00 

94 


N 

6 

14 

8 

8 

30 

1 76 


R 

Etc 





Etc. 

m 



Form 6 — Simple and Cumudativb Distridutionb of Ybah Law Grades for 
Aiii> Students in the School, June 1928 
(These Figures Are Hypothetical) 


Grade 

Number of students 

Simple distribution 

Cumulative distribution 

90 

1 

1 

89 

0 

1 

88 

4 

6 

87 

2 

7 

86 

10 

17 

85 

3 

20 

62 

8 

284 

61 

4 

288 

60 

7 

296 

59 

2 

297 

68 

3 

300 

Total (N) ,, 

300 



Applying section 11 Suppose mean law grade foi a Group X la 85, it is found 
here that 6,7 per cent of the total men in the school had a law grade of 85 or better 
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FonM 6 —Simple and CaMUiiArivB Diathioutioms op Examination^ Scopes on 
Tudb-palbe Examination in . , . , June 1028 

(ThoBO Figiircfl Avo Ilypothotical) 


Niiniijor of sfcuclonta 


Scoro 


1 

Simple distribiiiion | 

Ouimilative distribution 

20 

1 

1 

21 

1 

2 

22 

0 

2 

23 

1 ‘t 

1 ^ 

24 

! 3 

' i 

9 


4 

00 

56 

0 

00 

67 

1 

91 

68 

2 

93 

Total [X) . . , 

03 



Applying acctioa lit Tho iigura dotoimiucd for Group X from Form 6 waa 6,7 
per oout; 0<7 por cent of tlio total mon (03) tnking this particular oxainination is6; 
it is seen that tho examination scoro of 23 was attained or bettered by 0 men; 23 is 
the average standard examination score of Group X. 



THE SIGMAS OF COMBINED DISTRIBUTIONS 
CALCULATED FROM SIGMAS, MEANS, AND 
FREQUENCIES OF COMPONENT DISTRIBUTIONS^ 

C E GAEVEY 


National Scholar m Child Development, University of Minnesota 


It is Bometimea necesaary to compute for a aeries of measure- 
ments, not only the mean and standard deviation of the series as a whole, 
but also the means and sigmas of several fractional distributions, 
components of the total or general distribution The labor of calcu- 
lation IB thus doubled. If it is necessary to fractionate the data on 
more than one basis, ie, into more- than one system of fractional 
distributions, the labor involved is multiplied by the number of such 
independent systems of fractionation plus 1 (the general system of 
parameters). 

Obviously, this increase m labor can be kept down in the case 
of the means, by finding the smalleat fractional means first and using 
them to compute weighted means for the others Where x »= each 
measure and & = the mean of N such measures, the formula would 
be 


jVj +Ni 


( 1 ) 


in which subscript 1,2 refers to a distribution composed of distributions 
1 and 2. In practice, one operation is saved by using the form 


Sail -|- jSsj 

77i + W 


hn which 8 indicates summation. 

This procedure is familiar to everyone. The present purpose is 
to extend it to the calculation of the standard deviations The writer 
wishes to claim no priority for the following original formula, its 
essential features having been given in a similar one by Yule many 
years ago But since a survey of such frequently encountered texts 
as those of Kelley, Garrett, Thuratone, Fisher, Bugs, and Pearl 
indicates that the method is not in general use, it is thought worth 
while to present it here- 


^ The writer wishoa to thank Dr Florence L Goodonough and Phillip J. 
Enlon for reading the manuscript, without imposing ony responsibility upon either 
of them 
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Where A =* a; — » 


When d = * — aS and a5 = arbitrary mean 




Now 


c = 


Sd 

N 


then 


/Sdy 

~yj N ~ V-N j 

When ax - 0, then d == x, and 

fSx^ TSiV 


but 


BO 


and 


Sx . 


(S^ 

~ y N 


‘T* * IV ' * 




(3) 


Thia is essentially the formula given to his students by the late James 
Arthur Harris (published m 1910),^ and the one pointed out by 
Beardsley Ruml in 1916 ® 

Transposing and assigning subscripts designating fractional dis- 
tributions, we have 

^ = cr,* and ^ ~ - <r** (4) 

iVi iVz 


^ The Arithmetic of the Product Moment Method of Calculating tho Coclliciont 
of Correlation A'ltiencan Nainrah&ty Vol XLIV, 1010, pp, 093^690; especially 
695f 

* On the Computation of the Standard Deviation Psychological Bulleiinii 
Vol XVIII, 1910, pp. 444-446, 
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By summation and from equations (1) and (2) we have 


Sxi^ + 

Ni + Ni 


— ®*1,2 = O’*!, a 


(6) 


In machine calculation a table is set up, m which the rows are num- 
bered to correspond to the aubsoripts in the formulse, and which has 
the following eight column headings; 


1 

I ^ 

3 

4 

6 

6 

7 

s 

Sx 

N 

Sz^ 

N * 

5^ 

Sxi 1 
N 

Sxi 



Divide the data into fractional distributions of the greatest com- 
mon denoniinatoi, so that any desiied combined distribution can be 
made up from these fiactional distributions without further sub- 
division. Sum all the measures in the first small distribution and 
place the sum opposite subscript 1 in column 1 Place the number of 
measures in column 2 Square each measure (from a table), sum the 
squares, and place this sum in column 3 The lest of the table is 
self-explanatory, each subsequent entry being derived from previous 
entries Completion of a row of entries to column 8 fulfills equation 
(3). The mean and sigma of a combined distribution can be obtained 
by summing columns 1, 2, and 3, and calculating the entries foi sub- 
sequent columns from these sums. Any simultaneous portion or 
portions of these first three columns can be summed, and thus any 
desired distribution can be combined from the appropriate fractional 
distributions. This fulfills equation (6) for any desired combination 
of subscripts 

In reviewing Iiteiature oi in other cases where is not given we 
need a formula using sigma instead Prom equation (4) 


transposing and multiplying by JVi gives 

Sxi<‘ = (vi* -h 

similarly for Sx 2 ~. Then equation (5) becomes 

(vi* + + (ffg^ -h g2*)Ar 2 _ 2 _ 


( 6 ) 
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Substituting the value of Si.s from equation (1), and extending to 
include n fractional distributions, we have 

W + + (ff** + =22®)iV2 -H • • . W + 

iV, + ATj + • ■ JV« 

(S,)iV. H- + • ‘ , ... 

Nl^N^+~ ^ Nr, ~ 

This IS comparable with Yule^s equation (7)/ 

N = SCiVwt • + 2(iV.. ‘ 

except that here, equation (6)j we use the fractional means themselves, 
whereas Yule uses the deviations di, ^ 2 , of these means fiom the general 
mean xi.j, . n‘ Where these means are small they may as well be 
used directly, Where they ai e extremely large, the deviations are more 
easily used Experimenters should always report N along with x and 
sigma, so that their data can bo included in a summaiy, and so that 
reviewers can actually review the author^s work, instead of being 
limited to merely quoting the author’s conclusions. Of course, if a 
reviewer combines measurements made by separate authors, he must 
examine the comparability of the conditions undoi which the separate 
sets of measurementB were taken, just as ho must in case of sets of 
data taken by the same author or by the leviewer himself 


1 Introduction to tho Theory of Statistics,” 0th ed , London, 1029, p 142, 



A NOTE ON THE DEFINITION OF THE HARMONIC 

MEAN 

EUGENE SIIEN 
ICwang Iliia TJnivDraity, Shanghai 

The writer haa found that students completing an introductory 
course to statistical method often have a very hazy notion on the mean- 
ing of the harmonic mean. While they can make computations 
according to the formula, and even remember that its application 
haa to do with the calculation of average rates, they seldom appreciate 
the problem in its comprehensive setting They often fail to see that 
the correct use of the formula depends upon the joint operation of 
two factors: The way in which events take place and the way m which 
records are made. 

As the harmonic mean in educational psychology usually relates to 
the question of time and work, we shall take an illustration in this 
field. A group of students competing in addition may be required 
either to work during a uniform amount of time or to finish a uniform 
amount of work. Usually, records are made of the amount of work 
finished in the given time, or of the amount of time necessary for the 
given amount of work. The arithmetic mean in the two cases would 
correctly give the average woik per unit time and the average time per 
unit of work, respectively. For purposes of comparison, we can use 
either one with the reciprocal of the other. The harmonic mean is not 
called for. 

Sometimes, however, data are given, m terms of time per unit work 
when they are derived from a constant amount of time, or on the other 
hand, in terms of work per unit time when they are derived from a con- 
stant amount of work. In both cases, the arithmetic mean would be 
incorrect, and the harmonic mean should be used instead ^ 

The writer has proposed a definition of the harmonic mean as a 
special case of the weighted arithmetic mean where the weights are 
equal to the reciprocals of the measures “ The true average height of 
man is not given by an unweighted arithmetic mean of the heights 

' If in the foregoing we substitute price foi rate, money for work, and commodity 
for time, wo have a problem most frequently found in. the field of business and 
eoonoiuics 

* "The Foundations of Experimental Paycliobgy/’ edited by Carl Murchmson 
Clark University Press, 1929, p. 839. 
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of clilTorenl firoups by race, rcBitlonce, or political affiliation, becouae the 
groups vary in aizc ivntl should be given iKltcrenl weights in proportion 
to the population m each gioiip. Sunilnrly the uiuvclghtcd arith- 
metic mean of a scries of lulcs for a uniform amount of work is incorrect 
bccauBG the varying rates do not opertile for the same length of time, 
and noeda to be weighted accordingly, t-leurly the length of time for 
ivhioli each rate operated ia proportional to its reciprocal, and therefore 
the correct inonii is derived by weighting each rate according to its 
reciprocal This is precisely what the hiirinoriic mean is. 

It IS the opinion of the writer that tlic proposed definition leads to a 
more systeniatie und moio coinprehonsivo conception of the harmonic 
moan, He has found it of valuable assistance in clarifying the mind 
of such students as are apt to bo refractory to other methods of 
approach. Matheinatically it is of course equivalent and reducible 
to the usual definition, as the reciprocal of the arithmetic mean of the 
rcciprocnls of the measures: 


HM 


2(i7j) 2 (i7x) 


N 



NOTE ON THE STANDARD ERRORS OF THE 
STANDARD ERRORS OF ESTIMATE AND 
MEASUREMENT 


CHESTER B KELLOGG AND KENNETH W SPENCE 
MoCill UmvorBity 


In the course of research on the reliability of the high-relief finger 
maze, recently coraplclcd by the junior author of this note, and to be 
published soon as part of a comprehensive study, occasion arose to 
compare the standard errors of measurement of intelligence tests and 
various methods of scoring maze records In order to have a check 
on the validity of the conclusions drawn, we derived formulas for the 
standard errors of these and related measures. 

It might naturally be supposed that the standard error of a stand- 
ard error of measurement could be determined, as in the case of an 
ordinary standard deviation, by dividing by (2a)^^. In the case of the 
standard error of catiraate, SD„t = SD(1 — the corresponding 
formula docs hold good For taking differentials, we have . 

JOT', /■. ^M.'jc.T', SDrdil 

— (1 f ) ■'d&D 


Squaring, summing, and dividing thiough by n, 

SD\, = (1 - -1- ~ 2rSDi„aSDpSD.j 

cat — T J 


Assuming approximate noimality, and using formulas 32a, 1086, and 
125a from Kelley’s “Statistical Method,” this becomes: 


(1 - r*)SD“ , SDh-2(l - 1-2)^ 2 jSD X j (1 - r*) ,, SD 
2n “(1 - r-)n ■ ^ ^ (2a) 


which leduces to (1 — i'^)SD-/2n 
Accordingly, 


SD„ 

eat 


SD(1 - _ SD„, 

(2»)M (2n)«' 


Q.ED 


Similarly, for the standard eiroi of measurement, 
= SD{1 — r)^**, wc have, taking differentials 

dSD„^ = (1 - r)HdSD - 
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Squaring, summing, and dividing through by n, 

+ fl'T) 


-^2S1X1 - »•)»« X n., X SD, X 


2?i 


{1 - r)SD^ rT _ / SD X r ^ (1 - r") ^ SD \ 

4)i(l ^ ^ j 

which reduccB to SD’{1 — r)(3 — r'^)lin 
Accordingly, 

SD„__ - SD(1 - 

_ SD„.^ (3 - r^)^i 

(4n.)^^ 

To facilitate calculation of the SD.att,^, we have tabulated 
representative values of (3 — r*)^V(4n)^ 


r 


71 

00 

10 


66 

80 

90 

05 

09 

25 

.1732 

1729 


1006 

■H 

,1480 

1448 

1421 

30 

.1681 

1678 

1638 

,1460 


1351 

1322 

.1207 

36 

1464 

U61 

1424 

1357 


.1250 

1224 ' 

1201 

40 

1300 

1367 

1332 


1214 

.1170 

1146 

1123 

45 

1291 

1280 

1266 


1146 


1080 

.1069 

60 

1226 

1223 

1101 

,1136 

1086 

.1046 

,1024 

,1006 

66 

1168 

1160 

1136 

1082 

K 


0977 

.0968 

60 

1118 

1116 

.1088 

1036 

n t 

BuB 

0936 

0017 

65 

.1074 

1072 

1045 

nnji 

I 

B39 

0808 

.0881 

70 

1035 

.1033 

1007 

wf 


0884 

08B6 

.0840 

75 

1000 

0098 

0073 


B:[M 

B : 1 9 

,0836 

0821 

85 

0939 

0938 

0014 


1 0833 

B : E S 

0785 

0771 

100 

0866 

0865 

0843 

n!i?| 


B|f 3 

0724 

0710 

150 

0707 

,0706 

0680 


0627 

Bi!9 

0591 

0680 

200 

.0612 

0611 

0696 

III 


119 

0612 

.0602 


Although it is not likely to be much m demand at present, we have 
also derived a formula for the standard error of the standard error of 
estimate of true score, SD«.i = SDj(rii — (Kelley, formula 

160.) 


dSD 


“.I 


SD(dr — 2rdr) , . 

• K i -riW + <’• 


r*)>«dSD. 
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Squaring, summing, and dividing through by n, 

, - SD>SD>,|j::^ + (r - r'iSD’., 

+ 2SD(r - r’)M(r«SD,SD., - 


^ (1 - 4r + 5 j‘* + - 4r< - r* + 2r«) 

^ 4n(r - 


2r rr,dSDrSD,i) 
2(r - r“)« 


Accordingly, 


nj^ o-n/v - 3r + 2r^ + 3r3 - r* - 2r»)>4 

. - SD(>' - r<)» (4„,(r - ^))H 



NEW PUBLICATIONS IN EDUCATIONAL 
PSYCHOLOGY AND RELATED FIELDS OF 
EDUCATION 

CONDUCTED BY PRANCES M. FOSTER 


Educational Psychology, by Monroe, DeVoss Jind Reagan New York. 

Doiibleday Doran, 1930, Pp XIII + 607. 

Problems in Educational Psychology, by Gifford and Shoils. New 

York: Doiibleday Doran, 1930 Pp XIV + 728. 

These volumes are two from the excellently planned Teacher 
Training Series, edited by W. S. Monroe, one of the authors of the 
Educational Psychology The second text bated above was designed to 
supply companion readings to any basal text in educational psy- 
chology, but the anthois acknowledge that they had the Monroe, 
DeVoss and Reagan text principally in mind when they planned 
their work. 

The Educational Psychology is a wcll-construetcd book exhibiting 
many excellent features. In the selection of the aubjeot-matter a 
wise catholicity has been shown. The topics included are— The 
Physical Mechanism; Human Responses to Stimuli, The Learning 
Process; Learning m School Activities; Tranafei of Tiaining; Intelli- 
gence and its Measurement; Measurement of Achievement, Indi- 
vidual Differences, Charaoteiislics of Children at Diffeient Pedagogical 
Levels, The Psychology of Elementary-School Subjects, The Psy- 
chology of Higli-Sohool Subjects; Mental Hygiene; and How to Study 
Pupils. Such a list can be made strong meat and in then efforts to 
keep the text at an elementary level a few of the topics neccssaiily 
become a little obscure. The "limit of improvement" is an illustra- 
tion of this. Apparently the authors take up the position of behoving 
m limits for manual habits only; the acquisition of knowledge may 
proceed with ever-increasing facility Winch, of course, is a rais- 
mterpretation The authors have also hunted with the hounds and 
run with the hares in respect to subjective and objective observations 
although, aa aoientiats, they have emphasized throughout their volume 
the data obtained from carefully coMrolled experiments The best 
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featuie of the hook is the consistency with which technical terms have 
been used. When, for example, they wish to speak of intelligence 
derived from the use of a test as distinguished from intelligence as a 
theoretical concept they use "intelligence as measured” and thus get 
nd of any ambiguity. The Learning Exercises for the reader at the 
end of each chapter are truly cxeroises to promote further learning 
and are commendable. 

The Pioblems tn Educational Psychology is an anthology of excerpts 
or readings from works of 192 authors Thorndike and Woodworth 
are quoted the most frequently, and justly so. The selections appear 
to have been made more carefully than those of previous compilers 
such as Skinner, Gast and Skinner. By listing in each chapter 
"Suggested Problems” and "Supplementary Learning Exercises” 
some attempt to justify the selected title has been made. 

Both volumes aie well printed and strongly bound, and both are 
remarkably free from typographical errors. The reviewer wishes 
them the success they desei-ve. P, SANDiroRD. 

University of Toronto. 


Minnesota Mechanical Ability Tests, by D. G. Paterson, R. M. Elliott, 

L. D Anderson, H A. Toops, and E. Heidbrcder Minneapolis: 

University of Minnesota Press, 1930. Pp. XXII -j- 626. 

It IS a genuine pleasure to study the methods — so thorough, so 
cautious, and often inventive — ^which characterize this excellent and 
important investigation. Within recent years there have been 
published few other studies of similar thoroughness, so insistent on the 
accuracy of the mstiuments of measurement, so critical of their 
validity There is lenson to think that with this type of investigation 
(one would like to name those few others of equally fine caliber!) the 
measurement of human behavior has, within the last few years, 
achieved one more significant step in its advance towards recognition 
as an exact science In the field of mechanical ability undoubtedly this 
particular work is fundamental. 

The authors act out to investigate the field of mechanical ability 
to determine adequate answers to the two main questions (1) Is 
"mechanical ability” one ability or many? and (2) How is it related to 
other traits such ns verbal intelligence and motoi ability? 

By force of circumstances, similar to those experienced by investi- 
gators m the field of measurement of verbal intelligence, it became 
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necessary to define mechanical ability as "that which enables a person 
to succeed in a definitely restricted range of vocational and trade 
school courses ” 

A survey of literature in the field yielded twenty-four tests relating 
to mechanical ability These wore administered in a preliminary 
investigation to two hundred seventeen boys, all taking shop-work, in 
Grades VII and VIII in a junior high school. Nearly all of the tests 
were readministered after a suitable period of time, thus yielding a 
measure of reliability. 

The criterion selected was shop grades, determined as objectively 
as possible in terms of quality of work, quantity of work, and informa- 
tion displayed in examinations. 

The scores on every test were then correlated with (1) the criterion 
scores and (2) the average scores on two verbal intelligence tests 
Seven tests, yielding the highest correlation coefficients with the 
combined criterion, were selected to comprize the final battery 

Cl^foltll bfttt ^ bHtt + b»lt 61). 

The reliahiUly coefficients of these seoen tests ranged, however, from 
65 to .80. By lengthening some, and imposing a time limit on 
others, the coefficients were raised, theoretically at least, to range from 
.80 to .93, expectations closely approximated in the final experiment. 

In the experiment proper this battery (now known as the Minnesota 
Mechanical Ability Teats) was administered to one-hundred fifty 
incoming boys m the same grades at the same school. In addition, 
thirfcy-six other measures were determined, covering academic success, 
previous mechanical experience, interests, motor ability, anthropo- 
metric measures, social and economic status, and home influences 

The validity of the criterion was determined on the basis of objec- 
tive standards of judgement — the information factor on the basis of 
objective tests, and the quantitative factor on the basis of production. 
The careful construction of objective rating scales yielded a quality 
criterion (3:3 to 6.6 judges, depending upon the function measured) 
of reliability over .90 The reliabilities of the different shop cntenofi 
approximated .80. The coirelations of the individual tests with the 
quality-quantity criterion, however, were so low that the quantity 
critenon was abandoned. The validity correlation between battery and 
quality criterion alone was .68 The validity of the battery m respect 
of each individual type of shop work was found to be about as good as 



New Pvbhcaiiom 319 

that of most standard intelligence tests in respect of success in indi- 
vidual academic subjects 

Analysis of results in accordance with the principles of Spearman 
suggests that specific factors rather than a single general factor 
characterize mechanical ability There is, however, some evidence of 
the presence of group factors Four-factors, on the other hand, were 
found to be unique namely intelligence, height, agilily, and meohaiu- 
cal ability. 

The authors thus conclude m the mam (1) that mechanical ability 
as here defined is a unique trait, (2) consisting of a number of specific 
traits having possibly group factors in common. 

The reviewer would have felt entirely satisfied had the three 
following questions been answered (1) During the actual testing 
process what control was there over the possibilities of leakage of 
information concerning the tests? 

( 2 ) In 90 far as the criterion fails to measure originality’’ does it not 
fall short of what, with occupational reference, might be termed 
mechanical ability? (3) To what extent are these findings in agree- 
ment with those of a recent investigation into mechanical aptitude*’ 
by John W, Cox, one of Spearman’s pupils? 

Comment on the valuable investigation here reviewed cannot be 
allowed to pass without reference to the excellence of the binding, 
printing, and general layout of the volume 0 L, Hakvey 

University of Texas. 


Problems of Science Teaching at the College Level, by Archer Willis Hurd. 

Minneapolis, Minnesota' University of Minnesota Press. 

In these days of educational innovations and unproved panaceas 
for college ailments a bit of cautious, scientific investigation in the field 
of higher learning is like fresh water to the thirsty For some years 
college men have been protagonists for educational experimentation 
and research in the elementary and secondary schools. Student 
achievement and that relating thcieto has been measured and probed. 
Some of the most loudly advocated new methods of teaching have been 
partially examined However, perhaps because the beam seemed 
bigger in the other fellow’s eye, there has been comparatively little 
scientific investigation of teaching problems in college. It seems quite 
fitting that one should arise from the examined group and now lead 
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some study of a similar natuic in the realm of those who first made up 
tho game 

The work reported coneerns itself with the following problems: 
(1) What differences in individual achievement in the study of anatomy 
is produced between those who work in groups of two aud those who 
work in groups of four on a cadaver? (2) What is the effect of limiting 
the time given to laboratory work in human physiology or of partially 
replacing the laboiatory work with library work? (3) What is tho 
effect of ehmmatmg laboratory work in the study of " Mechanics''? 
(4) What effects has class sisso on individual achievement in the physics 
courses of and “Electricity and Magnetism'*? (5) What 

mfiuence does a high school course in physics have on the achievement 
of students in college physics? 

The details of the conclusions drawn from the studies arc, naturally, 
of special interest to college teachers of anatomy, physiology, and 
physics, The main finding likely to be of general interest is that 
class S155C m the courses investigated appears to have no influence on 
student acliievemcnt. In the words of the author, Achievement 
seems to bo more a matter of individual incentive, capacity, and effort.” 

Di. Hurd has nicely evaluated his work when he says, *'The 
studies * find their greatest value m actual, concreto illustrations 
of techniques in cdacationiiL cxperimontation. They represent 
attempts to settle problems of teaching by methods of experiment used 
in science." Tho discussion of tho outstanding references in the 
excellent bibliography and tho section of the conclusions on suggested 
techniques for this type of expenmcntation strike the reviewer as 
being particularly noteworthy Leokaup B Wheat 

Teachers College, Columbia University. 
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THE ASSOCIATION EACTOE IN INTELLIGENCE 

TESTING* 

S TOLANSKY 

Fellow of Aimatrong College, Newcastle-upon-Tyne 

Introduction 

A good deal of work has been done on the lohabihty of intoJligence 
testa and the constancy of IQ but very little on the analysis of lesponse 
error Holzmger^ considcis a response error (S) as due to fluctuations 
in offoit, emotional status, concentration, etc. Ho finds that this is 
roughly normally distributed, Slenquist* observes that, if the Terraan 
tests are repeated on a group, seven per cent are twenty points out, 
and this IS probably due to response error. An account is given in this 
paper of an investigation on the association factor m intelligence 
tests. The tests selected were from the American Army a Test, 
admittedly somewhat old Instead of allowing, say, the usual two 
minutes for a test, a modified technique was employed. The test 
was covered up The first question uncovered and the time taken 
to answer it was noted with a stop watch reading to one-tenth second 
The next question was imcoveied and the time taken This procedure 
was repeated to the end of the test. Very little time was spent in 
covering and uncovering and the timing errors cancel out. Only 
those questions done in the time stipulated in the test are considered 
for tho score By graphing times against Iho number of the question 
it IS strikingly shown that cei Lam questions (different ns a rule for each 
person) give abnormal times There are thiee possible causes of 
delayed response to a question. They are. (1) Ignorance of facts; 


* I wish to Ihnnlc Mr Voinon Blown foi assistaneo m the preparation of this 
paper 


321 



322 


The Journal of Educational Psychology 


(2) inability or partial inability to answer, through weakness in 
reasoning; (3) delayed icactioii due to an emotional association. 

In a good intelligence test (1) is reduced to a minimum and the 
cause (2), which la that concerned with intelligence, becomes important 
However (3) cannot be neglcctocl by any means Jung^ has shown in 
hia word association expcriincnls, that woida involving an emotional 
factor take a longer liino for a response than do words which do not 
arouse such a factor I have found as a result of exponenee that b 
delay up to ten seconds in ordinaiy word association is suiBcicntly 
common to be considered normal Suppose then that in a test, which 
has not been completed in the stipulated tune, there arc words ox 
ideas which call up associations emotionally toned, then, iricspoctive 
of inLolhgciice, delays will take place over these. The net result is to 
reduce the IQ, for had the time not been uselessly absorbed more 
questions could have been answered There arc, of course, associations 
to Gvory question. These can be classified into tho useful, helping to 
solve the problem, and the useless, of the Freudian oi Jung typo. If 
all the questions have been completed in the tunc, then the delays do 
not affect tho number attempted The possibility of useless associa- 
tion is purely accidental, depending on previous experience, and this 
may partly account for disagreements in reliability and IQ constancy 
observations 


EXPEBIM!!lNT,lU IVIctUOD 

Two testa wore selected, n true-false test and a multiple choice 
test. Both were given to five women and live men college students 
The reaction tunes were taken and the testecs were carefully watched 
The questions taking abnormally long tune were selected and the 
testee's attention drawn to them In some the delay was easily 
explained The testees immediately admitted lack of knowledge, or 
actual difficulty. The otheis, which predominate, delay was due to 
useless association The questions wore dealt with individually 
and a regular psychoanalysis earned out In every case it was found 
that the cause of the delay was duo to associations of emotionally toned 
oomplexes, some going back many years, some sexual, and some being 
I'epiossed incidents of an unploasant natuie. In piactically eveiy 
case the examinee was hardly aware that the time taken was long, yet 
in some instances a change from an aveiage of six seconds to a delayed 
time of seventeen seconds took place. It was often easy to IcU from 
facial expression tliat the emotions wcie distuibed 



The Assodahon Faeloj 


323 


It has been oonsideied advisable to reproduce the two testa since 
frequent reference will be made to them To illustrate the effect of 
useless association two tests have been selected at random from the 
twenty and the detailed analysis given The results of the twenty 
tests arc shown in Tables I and III and conclusions drawn from them 
are recorded 

Description of Tests 

Test I 

Typo, multiple choice 

Sixteen questions aro to bo answered 

TiaiG [Lllowed — ^ninety seconda* 

Sublesl 

1 It IS wiser to put money aside and not apond it all so that yon may: (o) Pre- 
pare foi old age and siclcncag; (i») collect nil the different kinds of money; 
(c) gamble if you wiah 

2, Shoes aic made of leather because* (a) It is tanned^ (6) it is tough, phablc and 

warm, (c) it can be blackened 

3. Why do aoldiors wear wnat watches rather than pocket watchoa? Becausa 

{a) They kcoj) better time, (6) they are haider to break; (c) they aro handior. 
4 The mam reason why stone is used foi binldmg pui poses is because, (o) 
It makes a good appearance; (h) it is strong and lasting; (c) it is heavy 

6 Why la beef better food than cabbage? Because*, (a) It tastes better; (h) it is 

moro nourishing, (c) it is harder to obtain 
0 If someone docs you a favour what should you do? (a) Try to forget it; 
(W steal for him if he asks you to, (c) return the favour 

7 If you do not get a letter fiom homo which you know was written, it may be 

because (a) It was lost in the mails, (?;) you forgot to tell your people to 
wnto, (ii) the postal service has been discontinued 

8 The mam thing faimcis do i8 to (a) Supply luxuries, (&) make v/oikfoi the 

unemployed, (c) feed the nation 

9 If a man who canT swim should fall into a iivci he should (a) Yell for help 

and tiy to soiamblo out, (h) dive to the bottom and crawl out, (c) he on his 
back and float 

10 Glass insulators aic used to fasten telegraph wires because (a) The glass 
keeps the pole fiom being burned, (b) the glass keeps the current from 
escaping, (c) the glass is cheap and at ti active 

11, If yoiu load of coal gets stuck m the mud what should you do? (a) Leave it 

theio; (b) get moic hoiscs oi men to pull it out, (e) thiow off tlio load 

12. Why aic ciimmals locked up? (a) To protect socictj'-, (h) to get even with 

them, (c) to make them wo\k 

13 Why should a maiucd man have his life insured? Because (a) Death may 

come at any tunc; (6) insurance companies aic usually honest, (c) hie family 
will not thon suffci if he dies 

14 In leap yeni 3 February has twenty-nine days because (a) Febiuary is a 

short month, (b) Some people arc born on February 29, (c) other wise the 
calendar would not como out light. 
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15, If you m hold up and lobbcd m a atmiige city you aliould (a) Apply to the 
police foi help, (W ask the fiist innn you meet foi money, (c) bouow some 
money at a. bank. 

16 'Why should wo have Congressmen? BecaUHO (o) The people must bo ruled; 
(b) it ensures tiuly vopicsontaVivo govevnment, (c) tho people me too many 
to meet and make their laws 


In a test of this nature a variation in time for each subtest is 
expected because of the vaiymg time^ required for reading, etc. 
This, liowever, is systematic and affects each person to a roughly equal 
degree Different rates of reading in different persons will seriously 
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10 0 
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seconds . 

120 

94 






96 

114 


160 


61 
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Mark score 


















obtained . 

11 

13 


16 


13 


16 

10 


8 


14 

13 


11 



affect the result, which is a bad fault m the test, Tho tunes taken 
by the ten people A to J are given in Table I The subtests completed 
in ninety seconds by each individual are shown above the black line. 
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The total times ave given to the neaiest second and below tbs the 
score obtained A full analysis will follow later The asterisk indi- 
cates useless association, the other long times are accounted for under 
headings (1) and (2) at Lho beginning of this article 

The full analyses for A will now be given, A is a woman graduate 
twenty-two years old. It is convenient to classify the first pait of 
each question as the statement and the three choices as I, II, III 

1 Pioblem (1) takes 10 seconds Statement caiieeg the following associntions 

^^Foresiglit — insumnce — doctor — ^illness — child — msuianco/' sisfcei is ill and 

the doctor called today Ho is the doctoi of a lady friend who mauied nn aihng 
husband* The husband died recently and the doctor had asked how the wife 
existed aad was told by A that the husband was heavily msuicd (see question) 
A child was boin to tho lady duiing the last ijlaesg of tho father A was sui prised 
and cynical foi the lady claimed alio had no sex knowledge and confided in A that 
she did not fileep with her hnaband, a point which stiuok A Ycxy foioibly . 

2 Pioblom (7) takes 9,2 seconds and choice II gave ''lack of letters — uiging 
at homo — disappointment with mothoi — upbiaiding Two years ago A was in 
France for some months and hoi mother haully ever wrote hci nlthoLigh her sisters 
did. She was disappointed and complained on ic turning She often blames her 
motlier for failuie to write, 

3 Problem (13) takes 7 8 eccondfl, the woid "insured” giving, “insurancc- 
agent— wife— poYoxidc — Peter,” Tlieio was a long pause aftei this A said 
”0h dash!” when the word "insurance-agent” slipped out That day her 
moth Cl told her she had seen an insuiancc-ngcnt who had maiiied a fair-haired 
gill and now had a child, Petei Some years ago A thought this man keen on her 
(note the dopreoiating, poiliaps lealous, remaik of "poioxide” lefcinug to the 
wafers fair hair) A said she was pleased he was now settled ns ho la a bit of a 
philandeier She was a little too anxious m digclaiinmg anything but fiicndly 
legavd 

4 Problem (14) takes a long time, 11 0 seconds, choice III gives two distinct 
tinins of association. 

1 "Ucfoim of Calendai — Juhug Caesar — month of August (named after 
Augustus) — Ilaivest Festival in August " A stopped and related the 
following. She lemembered when thice yenis old falling off a seat in 
church during a haivesfc festival Someone picked her up and threatened 
to steal her fiom her paienta She even lomoinbois the dicss alie was 
wealing at tho time ■ 

2, "Change in Calendai — St, Cuthbert’s Church — ^vicar — scuivy trick 
At tlie above chin oh A had taken a prominent pait in social life On 
removing she had neglected to say farewell to tlie vicai and thought this 
very bad TJie vicar wag very conseivativo and would certainly object to 
the lecent proposal foi fixing the date of Enstei 

6 The last question took an abnoimal time — 17 seconds. Choice II caused a 
whole group of aflsoeiations connected with the foot that A believes piesont day 
government is entirely undemociatic 
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Thia couoluclca the anal 5 ^sis, AUogeiher Ihirteen ciucstions were 
done in time, Thia is indicated by the line at thirteen in Table I. 
Tabic II, A gives a detailed result for testoc A, Useless association 
IB indicated by the figure 1 in Tables 11 and IV, and where the time 


Tauld II 



is long, due to the absence of useful association only, tins is shown 
by a figure 2.* When the question has been wrongly answered a period 
is given Thus 1* indicates a wrong answer and useless association. 
A thought problem (10) was of a technical nature, was afraid, and 
guessed, wrongly Eleven marks were scored. The average normal 
time for quCBtions, other than those marked by a 1, is five seconds. 
The five type 1 associations taking the long time of sixty-four seconds, 
z.e , thirty-nine above ilic aveiage Since thirty socondB more than 
the time allowed was taken, it is obvious that but for the useless 
association would have completed the whole test, and obtained three 
more marks. Thirty-one per cent of the questions which aic emotion- 


* KeJerred to as types 1 and 2 latoi 
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ally toned take seventy-one per cent of the time allowed From the 
analysis given thcie is obviously no doubting the strength of the 
emotional tone and its real effect. As seen from the table^ A is not 
the most extreme case. 

The second test, which was given to the same ten people, is as 
follows It IS the true-false type. Sentences had to be arranged into 
sense and marked true or false There are twenty-four questions 
and one himdied twenty seconds are allowed. A mark is deducted 
for each error, as usual, 


Test II 


1 Lions fltiong aio 

2 Hon sea people m live 

3 Days there in a week eight aic 

4 Leg hies one have only 

6 Mouth‘d coldest aic sunimei the 

6 Gotten sea water siigai is fiom, 

7 Honey bees ilowors gather the fiom 
8. And cat good gold silver to arc 

9 Piesident Columbus fiisb the was America of 

10 Making js bread valuable wlicat for 

11 Watei and made aio butter fiom cheese, 

12 Sides eveiy lias four tiiangle, 

13, Eveiy times makes mistakes person at 
14 Many toes fingeia as men as have 
16, Not cat gunpowdci to good is 

16 Ninety eanal ago built Panama ycaie was the 

17 Live dangcious is near a volcano to it 

18 Clothing Avoithlcss arc and foi wool cotton 

19 Aa all cots aro napkins used never 

20 People tuisfced mtemperato be always can 

21 Employ debatcis uony iievei 

22 Certain some deatli of mean kinds sickness 

23 Eavy bad malice traits and aic. 

24 Repeated call foi com tesios assiociations 

Full results arc given in Tables III and IV Full analysis is given 
for C who has the best mark and finished m one hundred seven seconds. 
As usual, a maik is subti acted from the total for every error, to correct 
for guessing C is a science student (man) aged twenty, 

1 Pi oblem (10) takes 5 4 seconds Associations wcic '‘cornheld — fresh air — 
house — removal Five yeais ago C had to leave liis house, the family going to a 
country house next to luhat was then a cornfield He is now of the opinion that the 
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change was an aci vantage, bnt was doviblfnl then He lecallcd hia nnxcd feelings 
at going to hvc in tho ctninliy 

2 Piohlem (10) takes 5,<t Beeonds, gvving napkin — set table — Chiisimas — 
Bpiilcd w»ne Borne \eA\& ago lie Imd spilled ti gltiss of wmc with his napkm at a 
Olniatmaa dinnci at home OhvistmftH ih Iho indy oeca&iou on wlnoh he gets ^YmD. 
It wos not leplficed, he though t it veiy wasteCnl, uimcd a tiibleclolhj and the 

TAllUi III 


(Time Allowed — One Hundred Twenty Bceonds) 


Ihoblom 

A 

B 

C 

D 

^ 1 

F 

G 

n 

I 


1 

5 0 

2 4 

3 0 

1 7 

3 0 

2 0 

4 0 

1 9 

2 4 

4 1 

2 

3 7 

2 4 

1 9 

2 2 

1 7 

2 0 

3 0 

1 0 

3 0 

2 2 

3 

4 3 

2 0 

2 2 

1 4 

2 0 

2 4 

3 3 

2 4* 

4 0* 

2 2 

4 

4 3 

2 2 

2 2 

2 4 

2 1 

2 2 

4 8*^ 

2 0 

4 0 

4 0 

5 

4 0 

2 4 

2 2 

1 4 

2 1 

3 0 

2 8 

2 2 

3 5 

3 5 

ft 

3 1 

2 8 

2 2 

1 0 

2 0 

2 8 

3 0 

2 5 

5 0* 

2 2 

7 

3 3 

2 4 

3 0 

2 2 

2 0 

3 2 

3 0 

2 5 

4 7 

2 8 

8 

12 0* 

2 b 

3 2 

2 0 

3 1 

r> 2 * 

4 

4 G* 

10 0» 

2 G 

0 

2 G 

3 0 

2 8 

1 G 

4 0 

2 5 

2 8 

2 0 

3 0 

4 0 

10 

3 5 

1 ^ 

b 4* 

1 G 


2 2 

2 0 

2 2 

, 3 0 

3 0 

11 

3 8 

10 b 

4 0 1 

2 Q 

C 0 

3 (1* 

3 0 

b 0 

1 IQ 2* 

2 1 

X2 

3 2 

1 0 

2 (1 

1 (1 1 

1 0 

2 G 

2 8 

2 0 

2 1 

2 8 

13 

12 3 

3 7 

2 7 

t) 0* 

2 0 

2 G*! 

3 0 

4 7 

3 9 

4 Q 

14 

3 0 

3 1 

C 4 

2 4 

3 0 

fi 0*. 

6 4*1 

G 0’^ 

4 0 ; 

3 0 

If) 

3 1 

1 6 

2 0 

1 4 

2 4 

2 0 

2 9 

2 7 

3 8 

2 0 

16 

0 2 

3 0 

12 0 

3 1 

2 4 

3 8 

9 4 

4 8 

5 6 

3 1 

17 

2 0 

1 9 

2 2 

1.4 

1 9 i 

2 2 

2 9 

4 0 

2 4 

2 9 

18 

5 0 

2 0 

4 0 

1 6 

3 0 

2 8 

11 4* 

3 0 

4 0 

3 2 

19 

m 4* 

4 4'" 

5 ,4* 

3 0" 

2 G 

3 O’' 

5 9 

4 0 

4 0 

6 0* 

20 

6 4* 

2 0 

6 0 

2 4 

2 0 

G 0* 

7 4* 

3 6 

3 0 

3 8 

21 

0 7* 

4 0^ 

8 8 

2 4 

5 0^ 

2 4 

6 2 

3 2 

3 4 

3 1 

22 

4 0 

3 4 

4 7 

2 0 

2 4 

4 0* 

5 0^ 

4 8* 

4 X 

4 G* 

23 

4 6 

3 2 

8.5* 

’ 2 2 

2 4 

3 0 

3 7* 

3 5 

5 0 

3 8 

24 

3 7 

8 0 

9 2* 

^ 2 0 

2 2 

8 2’* 

7 0* 

17 0* 

21 0* 

4 2 

Total time 

120 

77 

107 

53 

G8 

78 

108 

01 

120 

80 

Ma\k obtamed 

i 21 

18 

22 

ic 

18 

18^ 

14 

18 

T2~ 

18 


whole family laughed at him Ho vividly lecalls tlm mcidoiit The mental 
djstuibanco m tho teat was sfciong sinco ho also auswoicd wrongly, much to liis 
siirpiiao, on lator leadmg Ins answors 

3. Pioblcm (23) takes 8 6 seconds giving ^'bad temper — teachoi — blnmoless " 
Thico years ngo C ivae a pupil teacher in a aeliooh The class teaohoi was bad 
tempered, often striking children who were blameless This alTeoted him a good 
deal, 
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4 The last pioblcm takes 0 2 ecconda Associations aio Nurse— sistei’^ 
iTiothei Last aummor liia sister cut liei foot iii the Rticet oa some glass A 
nuise living noaiby liad toruled it Last month the iiiirae fell ill and C'a mother 
repaid the kindness hy tending hoi foi ihieo weeks C thinks the miiso fully 
desGwes this covutQsy 


TAnXiii IV 
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Theie weie four type 2 questions In (14) C wondered wliether 
or not thumbs were included as fingers and slopped some time. In 
(16) he took twelve seconds. Ho did not know the answer but guessed 
rightly, In (20) and (21) he had to pause and consider before deciding 
whether they wore true or false. 
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These two fully -worked examples arc illustrative of all Very 
profound associations were met with in some of llie tests. 7, whose 
avciflgc is about four, takes twenty-one seconds over the last question. 
Ilia mind, he said, was a perfect blank. Analysis revealed a strong 
sexual complex No person completely escaped the effect, 

Discussion or Uebults 

Tables II and IV yield valuable conclusions. Consider Table 11. 
The totals foz each individual are at the foot and for each question 
at the side It is obvious that problems 7, 11, 13, and 16 have a very 
strong tendency to produce useless association. Eight out of ten 
persons have type 1 association in question 7. The mean time is 
8.8 seconds, while for the next question it is only 3.9 seconds Eofer- 
ence to the list of questions Bhow.s these problems are almost certain 
to bring emotionally toned responses to anyone. Their content is 
such as probably to affect the average person; therefore this type 
of question, ought not to bo molndcd in the test, since it lesults in 
errors This method then acts as a Bclcctive agent m improving teats. 
There arc altogether thirty-onc of typo 1 and twelve of type 2 associ- 
ations Fourteen mistakes were made (neglecting problem 9) and of 
these nine are associated with type 1 ami fo-ur with typo 2 delays 
It was often, found that a strong disturbaneo resulted in a wrong answei 
as well as delayed rcBponse There is very little tendency to per- 
eeveration. This may be connected with the fact that a break occurs 
between each problem. Problem 9 is an amusing reflection on the 
authors of the test Seven persons gave wiong answers; they insisted 
that tho answer given in the book was wiong; the times wcie not 
abnormal. In this test a certain amount of latitude has been allowed 
for different rates of reading, G only gets eight marks, but he is 
a very slow reader, only fimshing ten. 

Now consider Table IV, Problem (19) is obviously unsuitable 
since seven people show associations of type 1 and there aio six wrong 
replies. Question (24) is unsuitable and (8) and (22) arc doubtful 
(11) is of interest since there arc live associations of the type 2 and as 
seen the question is actually somewhat rnoic diilicult than the vest for 
townspeople (but not for country people), Pioblcm (16) has six 
of the type 2 associations and six wrong answers This is due to 
absence of knowledge since the cxammce.s are English and the question 
refers to America. In this test there arc six and in Table II there are 
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eight questions \vhtch give no abnormalities of any description, i e , 
every one does them fairly quickly and gets them right. These are 
appaiently simple questions and the response time is small for each 
A sprinkling of type 2 is desirable, helping to eliminate the less capable 
Nineteen wrong answers wcie given (if problem (16), which refeired 
to America, is neglected). Of these eleven are type 1 associations and 
one type 2 

Conclusion 

It IS apparent from a general siuvey of the tables that the associa- 
tion factor is of real significance in affecting the rate of reply in a test 
In all four hundred questions wore set Of these one-hundied four 
take long times Seventy-one of these aie due to type 1 and thirty- 
throe to type 2 associations. There is a marked tendency for wrong 
replies to occur with type 1 delays Thus thirty-three wrong replies 
are made, twenty occuning with type 1 delays, and five with type 2. 
In many cases there is hesitation at the beginning of the test, the first 
question taking a long time. This is natural, and was not taken as a 
case of delay. Six out of the ten peisons would have answered more 
questions — and probably earned more marks — had it not been for 
useless associations Anderson'* has shown that speed of response in 
word association diminishes very markedly as the age decreases from 
fourteen years to eight years. It is thus quite probable that the delay 
effects will become worse with tests applied to younger children* 
These delays are present in all mental testing and must afieot scores 
and consequently correlations 

The method employed can be made use of as a weapon in the 
improvement of a test, by selection While the test used is not one 
of the later improved types, the conclusions are in no way invalidated. 
For any test which contains similai ideas to these (and most do) will 
produce associations The results indicate that an attempt should be 
made to draw up tests, in which a tendency to associate will be improb- 
able To show the effectiveness of this method of examining tests 
a curve is drawn in figiiic 1 with the results of I and J superposed 
(Table IV). J has made no eriois due to type 1 and has twenty-two 
marks, tune is eighty and Vs time one hundred twenty seconds 
The curves aro fairly parallel if the typo 1 delays aie not counted 
Thus a drop horn (4) to (5), a rise from (15) to (16), then a diop to 
(17), following With a rise to (18) is common to both cuives It is 
obvious that I and J are of about the same intelligence and actually 
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if not for type I cnors both would get fcwcnty-two marks Questions 
(8), (JO) and (24) nro of especial liileiest, ehowing how one person 
takes lliree and four seconds in ii normal response, the ofchei taking 
Ion and twenty seconds m an abnormal rosponse. Emotionally toned 



association, then, can not 111 two ways' (1) It can reduce the number 
of questions done, (2) it can produce wrong answers by disturbing 
the emotions 

To test the effect on correlation, a group of cxpciimcnts is now 
being conducted in conjunction with Mr. Vcinon Brown Tests 
are being given to a hundred chilclicn A group of oidinary tests, 
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,nvo ™g verbalism luid likely to give ^ 

and tor ooudaHon dotamined. T„ the same oh.ldrea a poup o“ 
the ilhtc a to type lost, laigcly gcomotucal m nature, is lo C 
giv a, and their correlation delerimiicd Since ssso lation „ to 
likely hole, the eoriclation is expected to be higher Heselt. Jil 1“ 
communicated latci, 


Rbpehences 


1 Iloi^iJtigoi Jownal of Educational Psychology, Yo\ XIV 
2, Stenqiiist Join nal of Educational Psycholonv, Vol XTIT 

3 Jung, ‘'Stiidic? m Woid Ahsocmtion." 1918. ’ 

4 Join nal of Educational Psychology, Yo\ VIII, 


1»23, p. 278 
1922, p 64, 
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TEl'RMD-DIli'FERENCES EOll VEllBAI. SUBTESTS 
IlELATIVE TO NON-VJ?nBAL SUBTESTS 


WILLIAM HTrOPIIIONSON 
Uiuvcisily C'ollpgp, liOmlon Univonity 

Inthouvction 

The pre&enL piipcM coiiLiaucs conHuIcnilioii of diilii gatheieci from a 
population of 1037 girla to whom had boon applied a “non-verbal” 
and a “vcibnP* gioup lest,'-® 

The Spemman Thcoiy of Two Factors has liccn sliown to fit the 
non-verbal sviblcat mtoi correlations with exactness,' while the verbal 
subtests only npproMiiiulcly fit the Tlicoi-y ® We observed excess 
orior in tho letnids for the verbal subLcats, of amount about 0.015, 
and tho many sources of oirnv biouglit foiward by us wore inadequate 
singly to explain it At the concluaion of our previous paper,® it was 
hinted that a summalion of many small disturbances might be taken 
to explain tho observed 0.015 excess error, but we could auapeet, with 
at least equal reason, that fuithor influoncca might be at woik in the 
verbal subte.sts. This latter suspicion, indeed, has some support from 
data for con elation tables (not reported here) for 100, 200, and 500 
sub-populations of tlie 1037 gii Is, where the non-verbal sublests showed 
nearly exact dimmulioii of tctiad error as the sub-poinilation was 
incicascd while the verbal subtcala uniformly showed excess error m 
tho tetrads, no luattoi what the size of the sub-populntion 

Howovei, the present paper is to bo concerned with intorcoirelaLioii 
tables containing both non-verbal and verbal aublosts, and new facts 
might be expected to onieigc from the comparison that wo iiic to make, 


iNTEBCOliniOLATIOKS AND TKTnAD-DJPPERENCES 

Table I gives mtcicoiielations for the seven vcibal subtesta Nos 
2 to 8® and tho foui non-verbal sublcsts Nos I, III, Y, and 
All were calculated for standard “normal'' score distributions,' wcie 
calculated by the diffeiencc method of scores; and weic checked in tlie 
usual way, and at the instigation of the tetrad criterion Wo have 
used only four non-verbal sublcsts instead of the available eight® 
because a table containing all would bo unwieldy for tetrad purposes' 
But in a later table we use obhci non-veibal subtests 
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We note m the firat place that the batteiy of seven verbal snb- 
tests correlates 0.65 with the battery of four non-veibal. Assuming 
that other subtests would piovide correlations similar to those m 
Table I, a batteiy of very many verbal subtests would conclate 0 82 
with a battery of very many non-veibal sublcsts. There is shown, 
then, a laige measure of concomitance for the verbal and non-verbal 
abilities, a fact that should not be oveilooked when we tmn to our 
main detailed intci cst in the placing of both types of subtesfcs m tetiads. 

We turn at once to this detailed examination of tetrads for Table 
I, The correlations with age show no disci iminalion for the veibal 
compared with the non-veibal subtests (see Table 111“^ and II®), and 
we continue without paitmlling out age correlation* Coircction for 
age correlation usually accounts for at most 0 005 excess error in our 


Table I — Piioduct-moment CouiiBLATioNa, N =* 1037 Girls 



tetrads We note that specificality might be expected for since 
siibtests V and 6 are of analogy type 

Theie are 990 tetrad-differences for Table I, with value as follows. 

Moan of 990 tetiad-diffai caeca 9 0355 

ObaeiYcd pe (conventional, mean X 0 815) 0 0300 

Theoietical PE (foimuia IfSA^) 0 0105 

Thus, the table shows eiior of amount 0 028 in excess of that attribut- 
able to sampling, and this is not noticeably diminished if tetiads 
involving ? 7 fl are eliminated 

Of the various tetrads entailed, those for only non- veibal sub tests 
give sampling ei'ror values, and the tetrads for only veibal sub tests. 
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entail error of amount 0 018 (in exeehs of samiiling ci’roi, as found m 
the previous paper ‘ 'J'liis latter, spread over llie 990 tctincl'diffcrenoes 
would amount to just about 0 002 of tljo 0,028 excess lluil ig actually 
obseivcd. The remaining Icliadn, to bo our concern in the following 
pages, may Ijc considered for convoiiiciicc in gioupa of the following 
types; 

line, r,,!,,, I 

Inii I ' f mi ~ lairi ’ I ««i* “ {zi) 

Ini^i lr>,,a ^»iia ~ I* (y) 

rni'ia * ma “ r,,,,, >nii3 I'" (j) 

Wbcrc n Btanda foi iv nonwoi Will, ami v (ov a vmUal wiUU'st, tlio Bulftmipts 
denotme cliffcvont subtests, taken toi all tlic eoinlunatioiih jiossibli* 


Tetrads of Type “Spcoificnlity in the "ciosa” conclations 
(j*„n) will bo shown in these tctiads, and it is important to consider this 
type before the a-type, because the "cross” conclations enter critically 
into a;-typc letiada The 84 tetrads of type si have the following value 


Menu . 0 0241 

Obspivcd Bigma (X 0 0745) 0 0104 

Oi, obsoivcil po (mean X O.B‘16) 0 0204 

TUcorotical Pli approMimtoly 0 OlOfi 


We have mentioned that r ,/4 may entail Bpccificality, and the elimina- 
tion of tetrada involving JVo leaves 70 tctiads, with mean 0.0226, 
t.e,, observed pe 0.0191 (conventional). The z, tctiads thus entail 
erior 0.01& in excess of aampling orioi. 

To explain this excess wo may try out the vniious possible disturbois 
of tetrads considered in pievious papeis That is, can age correla- 
tions, "speed proferonce,” "siimlaiity of relations,” group testing 
effects, calculation mistakes and the like, account for the residual, 
excess, ciioi, cither separately or as a whole? 

Eliminating all zi tetrads that might be disturbed by "speed” and 
"snnilaiity of relations,” leaves 24 tetrads with moan 0 0173, that is, 
obseivcd pe 0 0140, the theoretical value being approximately 0 0105, 
and parlialUiig out the C-ni ensure (the effect of school and class®) 
this mean is i educed to 0 0157, that is, an observed pc 0 0133 The 
excess error la now only 0.008, and it might be accommodated by age, 
and ealculfttional mistakes, using the proper sigma, instead of the 
conventionnl value (mean X 0,8453), also slightly reduces this 0 008 
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value Thus, elimination of one or two possible disturbances would 
result in the Si tetrads showing aatnplmg erior only 

Tetrads of Type — Thoie are 420 tetrad-diffeionces of this type, 

with value as follows* 

Mean of 420 tctiad-dilToiences 0 0263 

Observed po (mean X 0 8458) 0 0214 

Thcoiotical PB appioximafcoly , 0 0106 

Thoie IS excess error of amount about 0.018 in the above tetrads, a 
value similar to that observed for the verbal subtests. It is obvious 
that any specificality piesent in the verbal subtests will be potent also 
m these tetrads. 

To explain this excess error we may try out all the possible dis- 
turbers of tetrads known to us: But the result is the same as that 
obtained for the veibal aubtest intercorrelations, and we are left with 
excess oiror of amount about 0 015 (see that can not receive an 
explanation except by way of assuming a summation of many slight 
errors of the kind put forward for the Zi tetrads 

Tefiads of Ty'pB y — The 126 tetrad-chffevences of this type have 
value. 

Mean of 126 letrad-diffeicncea , , 0 0171 

Observed pc (mean X 0 845) , . 0 0144 

Theoictical PIS appioximatcly , 0 0105 

Omitting the tetrads which involve ?va brings this mean down to 
0.0164, t.e , obscived pe 0 0138 The excess crroi, like that for the 
Z\ tetiads, can bo accommodated by age, C-measure, and ^^speed” 
effect Even befoie making allowance for these two or three influences, 
the excess crroi is only 0 009> The y-type tetrads may thus bo taken 
to fit the tetrad theory. 

At the present junctuie we should ask whether an explanation 
of the excess eiror obscived in the vaiious tetrads, in terms of a summa- 
tion of a few slight CYiors duo to effects such as age, calculation mis- 
takes, etc., is reasonable and likely to have a factual basis. On the 
one hand the non-vorbal subiest intercorielations show no excess error 
m their tetrads * But the vaiious suggested disturbers o( tetrads 
mentioned above (and in piovious papois) are authenticated m other 
work. The influence of distmbers such as '^^speed^^ (foi subtests 
^ 'propinquity’ ' (especially for a.nd idiosyncrasies (for 
subtests 2 and 5, relative to all others), can be observed by using the 
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verbal eubtoats 4, 5, 0, mul 8, Logctlici wilh the non-verbal aubtesta: 
IL IS fclion found that (on cIiminalinR leti’fula involving rvo) a noticeable 
diminution is ohscivcd in tclruds which, apiiavcntly, arc not disturbed 
by influences of "speed,” "propinquity,” and "idiosyncraBies." But 
it would leiiuiio 9 cri’ors, each of inagiiilude 0 005 (the ainount usually 
found for the influcnco of age correlation), to cover an observed excess 
evi’or of 0 015 (■v/o X 0 005® = 0.015). Assuniing an excess observed 
error of 0.005 per inflnonco, for each of age, school and class, "speed," 
"propinquity,” "idiosyncinflios,” group losting, "similar leklioiis," 
and calculation mustalccs, a total excess error of amount 0.015 would 
result. The assumption, howevci, is perhaps nt moat only on the 
border-lino of acceptability. Thus it i» possible that the 0.016 excess 
error observed in tho ease of the verbal subtest intcrcorrelations,® and 
for tho Zt typo Ictiacls, can not bo reasonably ncccpted as due to a 
SHinnmtion of nurneroua small oriois of the kind biought forward, 
while, on the whole, the excess error sliown by tho «i and y tetrads 
(less than 0 010 in each ense) is possibly rcnsonably acceptable. 

Telrads of Type z . — This la the last type of tetrads to be examined. 
Tho total 252 a-typo tctiad-difTcionces have the following value: 

Meiiiv of 252 Iclrnd-differences 0 0703 

Obaeivcd po (mean X 0.845) . . 0 0605 

TheorcticaV 1‘3S appioMmatciy 0 0105 

Of the 990 totiad-diffoi'cnccs for Table I, (t) all the largest ere of Mypo, 
and (^^) all but thice of the a-Lypo are of positive sign when tho tetrads 
are in the form given nt (x) above, (Of cour.so, unless, otherwise 
stated, no regard is taken of the sign of tctrad-differciices, because for 
each positive diifercnco thoie is an equal negative diffoience ) 

If we omit tetrads involving j,*, 234 x-type tctiads remain, with 
mean 0.0720. No matter whnt effects wo try to make allowances for 
we always encounter excess erroi of amount about 0 059 If we allow 
0.015 excess error, attributable to a sum of disturbances of tlie kind 
accepted previously for other tetrads, there still vomnms excess eiror of 
amount 0 0 57 in the x-type tetrads for which we have as yet no 
explanation. 

Tho contiibuLions of the coirclutions to the x-tetrads are given 
in summary form by tetrads of tho following typo, wheic Vvt is die 
correlation ooncorned, taken with all the available non-veibal subtests, 
two at a timo; 

^ vv ’ ^ “ f 
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There aie 12 tetrads of this type for each and means of these 
sets of 12 are given in Table II. The mean for the 12 ^^-letrada for 
Tn 18 0,0992, for ? 24 is 0 0910, etc. No single correlation among the 
verbal subteafcs gives a small difference m these w-tetrads. The excess 
error seems to cover all the vcibal subtest correlations lelative to 
the non-verbal. 


Table II — Means por 12 Tetrad-differences (kmjype), for Tadlb I 



CONaiDBRA.TION OP THE X-TYPE ExiROR 

It IS obvious that neither age, calculation mistakes, nor propinquity 
effects can account for the icsidual error shown by the a;- tetrads 
Any general effects due to author’s idiosyncrasies can not be taken to 
be potent, because cr-tetrads for 723, 724, ^20, 7^27 and 728, and the corre- 
sponding conelations for subtest 5, should be free from residual error 
if idiosyncrasies were effective, since subtests 2 and 5 aio Thorndike 
subteats, while the rest are of the aiithoi’s construction. 

Group testing anomalies can not be taken readily to explain the 
residual enoi The effect is not noticed in the tetrads of any other 
type of tetrads It is true, though, that any effect characteristic of 
verbal subtests only (or non-verbal subtests only) would be observable 
under the cntical conditions piesented by the x-tetrads The x-type 
error, however, has been observed picviously under conditions free 
from group testing anomalies,^ and, further, a test of the influence, 
made by calculating sepaiaie r’s for each of eleven testing groups, gave 
results paralleled by the C-measnre conelations (given later in this 
article), VIZ ^ that the x-typo error remained when the influence was 
taken into account. 

If ''speed preference’’ enters the various subtests it does so in no 
obvious way. On introspective grounds, fiom the consideration ot 
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errors made in the fcesL-iinita, and from the general c\pcricnce with 
subtcBtB, we must eirbrnit that subteala 2, 4, 5, 6, ami 8, afford a battery 
giving good poivor-apced measure, and tliat the tetrads involving these 
Biibtesta are free from gross “speccl proCcictice” so far ns these subtests 
me concerned. Of the non-vcrhnl sublcals, I, III, and lY, are like- 
wise good power-speed tests, calling for the best that a child can give 
under conditions free fiom hurried, sliglilccl, woik, The ai-tetrads 
for these subtests show residual ciroi that cannot bo differentiated from 
tliat for any of the other subtests. If a inisbalaiico of the quantity- 
quality function ia cutical in our subtests, then it would have been 
found in previous work and, ccrUunly, tlio whole question of the 
function would loquivc ic-cxpciimcnlution from the foundations 
upwftid. 

Wo are loft, now, to consider the effect of "school and class” which, 
we say, may icscmblo the effocls that might bo attributed to group 
testing anomalies. 

The Effect of C-jnensw) e.— The C-me«suio“ is a scoic given to each 
gul, tins same for each girl m a paiticular class, on account of school 
"standing” and clas.s position. It is objective to the extent that its 
foundation is the order Standards lY to Vllb. It slioulcl serve, to 
some extent, as a mensuro of scholastic influences, such as reading 
ability. 

The correlations of C-mcasuic with verbal sublesl.s have been 
given previously The following new coi relations arc required 
^Oii) I'c.vni having values 0.3912, 0.3075, 0.3647, 0 2858, 

respectively With the coirelations now available we can calculate 
pmtial corielations for Tabic I, for C-moasuie iiaitialled out The 
resulting partial mtci corielations show that the non-verbal subtests 
have average intorcori elation 0.2973, the "cro.ss” corielations have 
average 0.2700, and the veibal subtests have average intercorrelation 
0 4503. It is obvious that the tetrads for such a table will agree, type 
for typo, with those for Table I. The icsults for the Zi, and y 
tetrads, for the n-totracis (non-verbal subtests among themselves) and 
r-tetrads (verbal subtests among themselves), are similar to those 
given above for Table I, except that slightly less residual orroi is 
observed throughout. The 252 a-typo tetrads Imvo value ns follows 

Mean, 2B2 *-typo tcliade, Table I, with G-mensuio partmllcd 
out . . . . . . ,0 0040 

Observed po (mean X 0 S45J . . 0 0641 

Theoretical PE approximately . , 0 0105 
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Oinitling tetrads involving JVa (analogy subtests) leaves 234 
tetrad-differences, with mean 0 0600; Omitting those for rss and rse 
m addition, leaves 213 tetrads, mean 0 0644, 

If we now allow, for those C-mcasuie paitiallcd coirelationa of 
Table I, the 0 015 excess eiior which might be attiibuted to a sum of 
enors due to “speed,” “propinquity” (especially for rrs), and “idiosyn- 
crasies,” age, calculation mistakes, and the like, we have still error of 
about 0.0512 for the -r-type tetrads, m excess of sampling error 
The grossest of these distuibances (due to “speed pieference” in 
subtests 3, 6, and 7, to “propinquity” for rrg, and to “idiosynciasics,” 
for 2 and 5, reiative to the other verbal subtests) should be absent 
from a-type tetrads for the four verbal subtests 4, 5, 6, and 8 (if ne 
IS duly accounted for) The a;-type tetrads for these four subtests 
with the four non-veibal subtests, for C-measure parbiallcd out, omit- 
ting the tetrads involving ?'6o, aic 64 in number, with mean 0 0511 — 
roughly the same as that above for the C-measuie partialled table 
as a whole, allowing 0.015 excess erroi 

Thus, with what may be deseiibed as the refinements entailed 
by the C-mcasuic partials, and allowing for excess erior 0 015 as the 
sum of that due to various specified disturbances, the a-type tetrads 
nevertheless show eiroi 0 050 in excess of that attributable to sampling 
and the specified influences 

A Second Intbrcoruelation Table 

We have used in Table I only part of the correlational data avail- 
able, and it should be determined whethei other mtercoi relation tables 
give lesults m agi cement with those already found in Table I In 
Table III we have included six non-verbal subtests and four veibal 
subtests' The “cioss” corielations for the subtests 11 and IV alone 
are new. 

Theie aie 630 tetrad-diffcicnces foi Tabic IV, with the following 
value . 

Mean of 630 lotrnd-diffpionecs 0 0294 

ObsQi ved po (mean X 0 845) . < 0 0248 

Thcoiotical PE appioximatoly . 0 0100 

Theie is obseived, once moie, appreciable error m excess of that 
attributable to sampling. We now consider the tetrads in the «i, 
2s, y, and x types. 
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There are 240 tetrads of type Zi foi Table III, with mean of ainouat 
0 0222; allowing for ?vc and r,i,viji (the formei because both V and 6 
are Analogy subtests, the latter because of the specificahty shown in 
the first paper'’) leaves 100 tetrads, with observed pe (eonvenUonal, 
t.e., mean X 0,8453) of amount 0 0130. Excess error of amount 
0 0095 is therefore entailed, 

There arc 72 tetrads of type 02 , with mean 0.0182. Ehiminating 
Tvfl leaves 66 tetrads, with obsevved pe of value 0.0142, ^.e., an excess 
error of 0.0100 

Some of the y-type tetrads for Table III have been included aheady 
in the results for Table I, but the 54 new tetrads of this type have 
mean 0 0144, or an observed pc of amount 0.0122, for the theoiotical 
PE of amount 0.0100. The excess error is now only 0 007. 

Tlius, excess error of about 0,0100 is found for the 0i, 02 , and y 
tetiads. Ifc IS obvious that age correlations will reduce this excess, 
and a sum of slight errors attiibutablc to ^‘school and class/^ calcula- 
tional mistakes, and the like, might possibly explain the excess on or 
shown by these tetiads, So fai the data confirms that found for 
Table L 

Theie aic 108 new x-type tetrads for Table III, with mean 0 0520, 
Eliminating tetrads involving lyc and loaves 90 totinda, with 

mean 0.0480. These x-typo tetiads thus show excess ob&civcd error 
of amount 0.0340. It is found that approximately this amount of 
error la associated with each for Table III The i«-type tetrads for 
Table III, for Ma, Ub, ub, rig, iob, lespcctivcly, have mean 0 0505, 
0 0554, 0 0516, 0 0448, 0 0615, and 0.0484. Thus no single ?i>u is 
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associated with small A-typo tetrad-cliffciences The results arc 
again similar to those obtamod for Table I The most significant 
tetrads arc those of A-typo, But when subtests II and IV aie included 
in the table of corielations, cas in Tabic III, the various errors concerned 
are less than those met with for Table I, a fact that should leceive 
consideration for a few moments. 

The subtosta II and IV coirolale with G-measure more highly 
than the other non-verbal subtests, and are like the vcibal snbtests 
in that lespect This may be taken to account for some of the decrease 
in excess erroi shown by the 90 r-type tetiads, when compared with the 
213 A-type tetrads for Table I, It is a matter of some interest to pay 
regard to subtests III and V, comparing them with subteats 11 and IV, 
On the one hand, it may bo suggested, the subtests 11 and IV me not 
BO "novel” as subtests III and V (or as I and VIII as well); they 
are not so likely to be so dependent upon fore-practice, not-clear- 
understanding of the tost requuements, conative inhibitions, and the 
like It might be consideied that effects of this kind have entered 
significantly into the x-type tetrads for Table I, so explaining the 
diffeiencG in amount of excess cnoi observed for these tetrads m 
Tables I and III On the other hand, subtests II and IV can not be 
said to be of much intrinsic woiLh os instruments in which eduction 
is critical: "Wo would place more value on subtests III and V, which 
are perhaps the best of the non-verbal in point of eduction mechanism, 
Wc took some pmns, m our first paper,'* to show that )„i,v could not 
be taken to entail specificaliby lelative to the lest of the non-verbal 
subtests, and the excess observed erroi for the A-type tetrads for 
rjii.v IS approximately 0,090, Thus, against a possible influence such 
as " novelty” (including therein influences like not-olear-understanding^ 
of the test directions oi requirements etc ) we can but place the knowl- 
edge that subtests III and Y involve eductive mechanism to an extent 
that can not be vouchsafed for subtests such ns II and IV. Wc aie 
not disposed to accept the view that “novelty” and the like can be 
taken to account for tho greater excess erroi obseived in the a,-type 
tetrads foi Table I, chiefly because influences that might be anticipated 
to be as oifoctnal as “novelty” (such as, say, ago effect) do not show 
excess enor so large as this under coiisideratiou, namely an amount 
0 036, given by Vo 050“ — 0 034“, wheie 0,050 is the obseived excess 
enor m the .t-type tetrads for Table I, and 0 034 is that for Table 
III However, theio is lOom for furthei work in which the matter of 
“novelty,” fore-pi notice, etc, can receive critical attention The 
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mattci, indeed, is to locoive ftlloiition in some work that we have 
began with n 5t)0 population. 

Finally, to continue the consideration of Table III, wo must con- 
clude that the .-c-type tefciada show cxcc.ss error that can not receive 
adequate explanation m terms of the many influences brought forward 
by 118 in the couise of this and provioua papois The data for Table 
III IS similar to that obtnined foi Table I 

Thus, after taking account of many houi-cob of orior known to us, 
including scale anonialies, the cUccls of school and class, calculation 
mistakes, age effects, “speed preference," group testing anomalies, 
etc, we arc left with a not inconsiderable obscived excess error in 
a;-typG tetrads I'or nil the r-type tetrads that can bo constructed tor 
our verbal and non-verbal sub tests this excess error is not less than 
0.050 in amount, after making allowance for sampling and for an 
amount 0.015 attiibutablc to influences nuch ns age, etc. 


The PnoniiKM op a VkkiiaIj Guoup Factou 

A gioup factor may be shown for the veibal aubtest intcrcouek- 
tioiis when (7„ (the common factor observed in the non-verbal sub- 
tests') 18 pai hailed out. Using the non-verbal subtests ns “lefoience 
values," in terms of which the (/-saturations of the voibal subtests 
may be determined,* we calculate the specific conelations^ for the verbal 
subtests among themselves; The results arc given in 'J’ablc IV. The 
Table is for G„ pavliallcd out. We have to decide whothci these speci- 
fic corrclatioiiB fit the tetrad criterion, so that a group factor may bo 
taken to run tliiongh them. 


Tadub IV. — Pautul Coiiuni.ATioMs, poii rAimAt.i.ED Out, Dbhived fiiom 
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There aio 105 tetrad-differences for Table IV, with the following 
value' 


Mean of 105 tefciad-d iff ei cnees , , . 0 0196 

Observed po (mean X 0,846) , q OKjs 

Theoretic a1 PB fipproximatoly , 0 01 00 

If we eliminate totrads which involve and rso (which, we have reovsou 
to suspect, involve specifioality due to similarity of lelations), the 
above mean is leduced to 0 0166, i e , theie is observed pe of amount 
0 0139| for a theoietical PE 0 0100 It is obvious that by partialling 
out age con elation and C-measure this observed pe will become nearly 
exactly the same as the theoretical value We conclude that the Two 
Factor Theory fits the specific conelations The new factor, which 
appears to be common to our veibal subtests, may be named V> 

We have arrived at the conclusion, then, that the verbal subtests 
involve two common factois, ffn, which wc would take to be the uni- 
veisal { 7 -factoi, and V This may explain the apparently intiactable 
lesiduum of observed enor in the tetrads for the verbal subtest inter- 
correlations (comparing the results found in oui fust paper ** with 
those foi the second paper,® for the non-veibal and verbal subtests 
lespcctivDly), and in the totiads for, as was suggested earlier m this 
paper, ^ thee excss enor tlicre seemed to be on the border-lme of accept- 
ability in terms of extraneous influences of the kind school and class, 
age, etc Now the ictiad effect of two common factors becomes 
scarcely disLinguisliablo from that of only one common factor when 
the correlations are of nearly equal magnitucle, and it will be noted 
that the voibal subtest mtei conelations aio of such a neaily equal 
magnitude Thus, if wc accept the (?„ factor found for the non- 
verbal sub tests, and the V factoi found in addition for the ver- 
bal subtest mtei conelations, then the lesults obtained for the tetrads 
of the verbal subtest intercoi relations fit well with the theoretical 
expectations, 

We have now to turn to consider explanations of the V common 
factor, of the observed excess error m the :i-type tetrads 

If the various effects and conclusions considered in the course of 
our papers aie acceptable, wo have inductively naiiowed the field 
of possible explanations for the F-factor* We are left, indeed, with a 
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possible explantiUon in lornifi of '^vorbality ” It is true, however 
that doubts remain, especially conceuung the influence of speed/' 
novelty'' anclforc-piacticc, and conalivo dilfcrcncoa in Ihc verbal and 
non-vet bal subtests. JTowever, our claia are nob pub foiwarcl aa 
a finished pioduot, but as punmnly an c\cveiso in correlations, iotiads, 
and errors otlicr than sampling Tlio verbal and non-verbal subtests 
used in our woik, while being siinilar to those generally used m 'hiiicllb 
gonce" tests, aic not complotoly Huilecl to work tliafc would make 
contact with matters of sciculidc jisychology: We can now employ 
tests which entail cduclive principles moie llnnoughly, we can com 
struct bettej non-verbal mibLcsts on pnmanly perceptual linos, We 
have under way a ic-evp crimen tat ion with a 500 population, which, it 
is hoped, will go far to place us coircctly on the path of facts of some 
psychological value It is with knowledge of the limitations^ and the 
need for further woik^ that wo turn to coniiidoi ovn y-fiietor in terms 
of '^voihality/' 

Wo should ask, in the fii.sl place, how wide the V-faolov might 
bo expected to extend. Is it likely that it will extend thiough all 
verbal subtests whatsoever, so constituting a veibal gQne)al factor? 
Or is it likely to be confined to the cnllccliou of verbal Bubtests used in 
our exponmont, ao constituting a limited factor? 

Wo have observed disturbances in r-typo tetrads previougly,^ 
for other veiba! and non-verbal subteaLs. But it is moic important 
to recall that work by Davoy,^ although obtaining icsults that cor- 
respond apparently closely with ouvs, yot found that icsults for two 
verbal aubtests did not concaponcl witli the moic usual result, indicat- 
ing instead the absence of any verbal geneial factor or factois Tlius, 
Davoy took the view that the spccificality shown by verbal aubtests 
must be of limited lange Further, the spocificality obseived for some 
of her veibal subtesta was attributed to ^'sunilavity of rclaLious " 

Comideraiion of Dauey's Data and Conclusio^i — Davey's work was 
with voibiil subtesls, orally applied, and pictorial siibtests Now 
pictorial subtests arc at best only secondarily pciccptual Woids and 
sentences are used in the test diiocfcions of all our subtests, but once the 
piiiposo of the siibtcsi is ^^Rot," a diffciouco between our voibal and 
non-verbal subtests is that words arc not ostensibly used, even iinplic- 


* One poasiblo mfluciico, so far not moiiLioncth ifl that of mi citcefc duo to tlio 
aiib testa being applied a day apart Previous work, howovci, sliows that Buch lui 
mfiuenco must bo slight, at most 0 005 ciior lesultmg in a:- typo tetiads 
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itly, in the non-veibal subtests (excepting, aay, sublest IV). This 
condition, however, might not have held in Davoy’s pictorial suhtests. 
Again, some of Davey’s pictorial suhtests had words ol sentences 
diiectly involved (pictures had to be selected to match short para- 
graphs with words omitted, names of items in pietuics had to be 
written down, etc , these verbal parts being orally applied) Thug, 
there is a possibility that woid-ontailment, with possible “repioduc- 
tion” individual diffeienccs,‘ is not subjected to sufficiently critical 
oxpeiiment in the pictoiial subtests. Some of our non-verbal sub- 
teals aie more primarily peiceptual than piotoiial subtests can be. 

Wo have some evidence that the oral sub tests used by Davey entail 
speoificaUty relative to othei verbal aubtests,’ and some of the spccif- 
icality observed by Davey might be attributable to an influence of the 
oral presentation The oral Analogies, Opposites, and Classification 
subtests entail spocificnhty which Davey attributed to ‘'similarity of 
relations,” and our work offers some support for such a specificality in 
these suhtests. But the V-factor in our woik is observed over and 
above this latter specificality, and likewise over and above any factor 
attributable to picsentation of the test material It seems that the 
F-faotor is over and above any specificality found by Davey, a matter 
that would follow upon acceptance of the arguments put forward in the 
previous, and following, paragiaph. 

Again, the oral Inferences and Likelihood subtesta, which alone of 
Davey’s subtests did not show excess error in the a:-type tetrads, and 
upon which the conclusion concerning a limited factor depends, cor- 
related only 0 35 (approximately). Under the conditions most verbal 
subtests correlate more highly. The test-units in these two suhtests 
are somewhat lengthy and complex m stiucture, especially perhaps for 
eight to ten yeai olds of Davoy’s eight to fourteen yeai group. It is 
possible that not-cleai-undcrstanding of the test lequiiements, oi 
excessive memorization effect,^ or lack of ability of keep the whole 
test-unit before the ''mind’s eye,” have entered ciitically into these 
two subtests, resulting in a smaller correlation than might be expected 
in the circumstances 

Thus, tlic facts are perhaps not too strongly in suppoi t of the con- 
clusion conccimng a luniLed veibal factor, and nothing hitheito found 
in this field can be taken to contiadict the facts found in oui work 

After eliminating diatuibanccs duo to vaiioua possible influences, 
oiir work indicates with some certainty that specificality inns thiough 
our verbal subtests, and amounts to a single factor that we have 
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named V The speciricnliLy would iippoiir to bo the mote discernible 
the moic the non-verbal sublesl^ lend towards being primarily per- 
ceptual. Further experimentation is icquired before wc can decide 
that the F-fnetor i.s very extensive, but our work may bo taken to 
tend to indicate that llic F-fnetor would possibly oxtciul through most 
verbal siibtcsts in current tc.sts of "iiitclligenco. ” If oiu consideration 
of Davey’s conclusion ha.s any factual basis, then wo may conclude that 
no work extant contiadicts the possibility of their hciug F-speciftcality, 
approximately a single F-factor, of very wide langc 

The posBiblo contact of this V'-apeciriciiUty with “vcpioduction'’ 
lias been touched upon in the picvious paper,® and wc would .suggest 
that the facts of the general law of rclontiviiy of dispositions,* inbro- 
spoction, knowledge that wc have of individual diiTcrcnccs m the cate- 
goi ICS specified,® and the facts of aijhnsm, all tend to support a view 
tliat F-spccificnlity might be expected as the conficquencc of individual 
difforcnccs that we have covered by tlic term “loproduction” i.e., 
reproduction of words, phrases, scntonce.s, oi ideas The theory, in 
any case, seems worthy of further cxporimentnl attention. It is not 
improbable that “ivpioduction” const ituies an influence in the ‘'speed 
preference’’ effect in verbal sulitcsts. 

For the present, then, we would say that it is po.sslblo tluil when 
repioductlvo influences are allowed scoiio m subtosls, then F-specif- 
icality would lend to show. Similarly, no doubt, vooabukiy can 
augment the F-specifioahty; although our data give no indication that 
the F-spccifioality is conditioned by an antithesis that was employed m 
the verbal subtests. (Siibtests 3, 6, 7 and 8 were constructed of words 
with simple concrete moaning, while 2, 4, and h contained words ol 
more abstract incaning ) 

In point of fact wo obtain F-factor extending through all our verbal 
subtests, tending to indicate a general F-factoi in addition to the uni- 
versal {/-factor in verbal aubtesla We have mentioned pieviously, 
hoAvever, that the conclusion is tentative There is looin for iinprove- 
mont in the matter of the facts, and wo await with mtei ost the results of 
our second experiment with other verbnl and non-verbal sublosts 

CoNOLUSIONa 

We have covered a mass of oorrolatioiial data in the course of two 
papers ^■® and the piescnt one, dealing with eubtests applied to a 1037 
population of girls No doubt brevity has left marks of ambiguity or 



Ttira&diffevmceB /or Verbal SuMests 


349 


of unintelligibility, fox we have had to give conclusions frequently 
without much refexenco to the relevant data. There aie likely to be 
found eiToi's of calculation or transcription But any leworking of the 
corrolaiional data would, we submit, give us no cause to depart from 
the following general conclusions. 

1, The non-veibal and veibal subteats have a high coiielntion, amounting to 
0 82 foi R summed correlation for many eubtests of both kinds The fact stands 
m opposition to the opinion a that liavo sometimes depicted the two abilities as 
independent 

2 111 the case of tho non-veibal sub tests, tlio totiad-difTcrcnces matched with 
some exactness the value to be expected from sampling error ^ This held good 
regardless of the aize of the sample, foi sub-populations of 100, 200, 500, up to 
tho full 1037. 

3, In the case of the vcibnl subfcosts^ the tetrad-dilfeiencos weie appreciably 
larger than those to bo expected fiom aatnpling alone After making allowances 
for Gviclont disturbances tlicio remained excess ciioi of amount appioxunatcly 
0015, a value aeaicely to bo accepted as mcxcly due to distuibancea o£ tho kind 
considered in explanation of it 

4 But much highei loaidual error came fiom tho tetrads involving both veibal 
and iion-voibal bubtest conclntions This was of magnitude about 0 060, thus 
indicating with ccitamty some factor or factois m one ov both of the two kinds of 
snbtests 

6 On. closer examination the ovidonco was against any gioup factor m the 
non-veibal subtesta, but 'was in favor of one gioiip factor extending rather evenly 
throughout the veibal snbtests Sucli a factoi, moreover, would explain the 
roughness of the fit of the totiad formuia to tho veibal subteat intereoiielntions, as 
mentioned at (3) alieady given 

G On tho whole, tho indications arc that tins F-Cactov extends thiougli all 
veibnl abilities, and theiofoio may be called a genoial factor V (as contiaated with 
tho imweisal gcncial faotoi p which is found in both veibnl and noii-voibal subtests 
alike) On this matter, howcvoi, thcio aro icqiiucd fuithei facts These are to 
leceive consideiation in n subsequent oxpoiimenb 

In conclusion, we would offei, once inoie, our very sincere thanks 
to Profcssoi Spearman for willing guidance, for many aids to a cleaier 
view of facts considered, and for many kindnesses given thioughout 
oiii woik m his Laborntoiy It has been a true pleasure to have been 
a student and Research Assistant under Piofcssoi Spearman, 

Refeubnces 

1 BAvm, C. M , British Jownal Psychology y Vol, XVII, 1026, p 27 

2 Spearman, G ''Abilities of Man Their Nature and Measurement” The 

Macmillan Co , 1927 
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ORGANISMIC PSYCHOLOGY AND EDUCATIONAL 

THEORY^ 

KENNETH SELTSAM 
Ilmvoiaity of Minnesota 

There has, within the last five years, come into piomiucnce a 
so-called now school of psychology known in its original setting as 
“Gestalt-theoiie,” as "Configuiational” in the translation of Titch- 
ener,* and still more recently in the language of Wheeler, ns "Organ- 
Very few people arc awaie of the fact that in point of origin, 
at least, it is almost contompoi ancons with " behaviorism/’ that if 
anything, it is older of the two.'' Whatever may be the opposed 
contention of systematic authorities, the membeis of the school 
consider it to have begun with a study of "apparent-movement” 
made by Wertheimei ui a Geiman laboratoiy some time in 1912 
Its longer smvival than that of behaviorism, it is said by some, may 
be attributed to the fact of its iclative slow growth However that 
may be, the orgamsmic thought is demanding serious considoiation 
from psychologists in general It is forcing the perhaps too long 
unquestioned orthodox psychology to make a moie careful invoice of 
stock And in that probing process, if we may so name it, educational 
theory has not been, and cannot be, immune 

The Main Contentions op Ouganisahc Psychology 

Before considering orgamsmic, oi gestalt psychology, as it is related 
to educational theory, it would perhaps he advantageous to inquire 
into the school’s main contentions Roughly they may be classed 
under two heads: Those relative to the circumstances involved in 
any event, and secondly, those pel taming primarily to the individual 
expenencer, To the first of these, would be given the name situation- 
as-n-wholo. A lesponse, the organismio psychologists say, is never 


^ The Editoi announces with regret the dostli of Kenneth Scltsam on Nov- 
ember 30, 1930 This papci wos picpaicd by Wi. Seltsam while at the Univeisity 
of Kansas 

® Helson, H American Journal of Psychology, Vol XXXVl, pp 313, 405, Vol, 
XXXVII, pp 25,180. 

’Wheeler, E II “Tho Science of Psychology ” 

* Boring, E G “History of Evpeiimontal Psychology ” 
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made to an isolated stimulus. The S — > li dcsciiplion of events ^vhich 
ig presupposed by the theories of nssocintmn, attention, and behavior- 
ism 18 obvioimly not true to tlio facts of the ca.se, A response (to 
Slate the law of confiRuration) is made to a 8 ltuaUon-ftb-a.^vholB, 
and if to any piiiticulnr detail, always to that detail in its lelatioa 
to the other details. The oiganisimo position niaintiuns also that the 
pHychologicnl silmitioii is not dilTercnt fioni the choinical or the 
physical in its Kcnoral aspects, and is, tlierefore, governed by similar 
natural laws. 

One of the natural laws which is seen to have considerable psy- 
chological significance is the Law of Least Energy, whose statoinent 
for application to the field of psychology is not essentially different 
from that for other sciences. If niovoinent of energy la always in 
tlio direction of ii low potential, one immediately comes to realize 
that such concepts as “Trial and Fa-ioi” aio at best absurd It is, 
according to this manner of facing tlin problem, absolutely impossible 
for an oigaiiibin to act without accomplishing Boiiiothing with icgnrd to 
the point of low Bticss, which oiganisimciilly is dernied in any leaining 
aituation as the “goal." In general, the sitiiation-ns-a-wholc is seen 
to be an cnornioiisly complex thing. As such, it cannot be rcpicsentccl 
by the tremendously "un-coniplox” symbol *S', as that sign has his- 
loiically been used. 

As one might cvpcct, the organiHinic psychologists have still moic 
lo any of the organ ism-as-a-wholc They i elicl violently against the 
ntomiatio physiology of the conditioned reflex school and othcis, 
They maintain that structuial analysis can never act as nn end in 
itself; that to assume that psychology is lo icach the lanks of a science 
through the analyses of groat intiospcctioni.sls, as the Titcheiierian 
formula reads, is an impossible absuinption. The oiganism-as-a- 
wholc 13 to be appioaehed as an integrated unit through the medium 
of functional analysis. Experimentation is to be conducted by 
alteration of the conditions; and when this alteraLion takes the foim 
of extreme limitation (as in the case of neural study) it is lo be recog- 
nized that the results are to a coitain (‘xlcnt, at least, absti actions 
from the real phenomena, Just as it is impossible to think of a aitun- 
tion-as-a-wholo m terms of S, so it is, in tlio light of the oiganisinic 
position, iinpo.ssiblo to label tlic icaction of the oi ganism-ns-a-whole 
as R, simple rospoiiso. 

In gcneial, the majoi contentions of tlic new .school may be summa- 
rized very crudely in what w’ould seem for them a definition of the 
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science Psychology is a science of ^Svholes” which deals with the 
responses of organisin-as-wholes to situalious^as-wholes Anything 
short of these, on the one hand is essentially physiology, and on the 
othei, physics 


Thk CiimciSMS OP GKft'iAr/i', on Oiiganismic, Psygiioiogi 

The structuralistic psychologists, in the ineautime, have not seen 
fit to accept these violent ciiticisins as such* One should not expect 
them to do so One of the typical Tcjoiiideis, and one peihaps less 
logical than other, is that the new school is, after all, not new 
One finds such statemonts as the following frofn. Bormg ^^Like James, 
Dewey was a Gestall-psychologe twenty years too soon^^^ Squires 
m a recent comment demands that above all else in our dealings with 
the new school of thought, wc maintain a “balanced historical souse 
In a semi-popular discussion, involving about as much over-statament 
as might be expected of such, Kobmson would have us believe that 
not only is the pimciplc of configuration not new, but of questionable 
actual significance ^ 

The prolilcni of the age of any line of thought is strikingly para- 
doxical Age is at once both desirable and undesirable Were 
IS not possible to tiaco oiganismio thought bade tluough the history 
of psychology — through Dewey, McDougall, James, the Mills, Stout, 
and oven back to Empecloclos in the third contuiy B G — oithodox 
psychology might have grcalci ground still for criticism That 
it has been a development, an cvolutionaiy outcome, rather than 
a scientific upstait should, it would seem, be a favorable indication 
It IS, also, quite possible to loconcile the fact of age with the idea 
of a new contribution to make To assume otherwise is to admit that, 
Since “there is nothing new under the sun,^^ it is futile to attempt 
originality, and that neithei sociological nor moie naiiowly scientific 
movements have any cfesenlml evolutional y value 


^ Boijng, ID O Iliatoiy of Expeinnentnl P^^Ychologj^ American Journal 
oj Psychology^ Vol XLIT, Apr , 1930, p 510 

2Squuc8, P, Cl . Gestalt Psychology unci tlio Gestalt Movement, A Ciiticism 
of tlio CoiUiguuilioiiist's Intel pi otatioii of *'Stiuoturaljsm " Aviencan Jownal 
oj Psychology^ Vol XLll, Jan , mSO, p 134 

niobmsou, ESA Little Gcimaii Band, Nm RcpuhliOj November 27, 
1929, p 782 



354 


The Jamnal of Educalioml Psychology 


Since a KJoat (Jml of the oiganisniic cxpoiiuiculalion, has. hmi 
conducted with lumnals/ in a uiannea somewhat strange to traditional 
method, it is «iud by bom« tlml llie RcsUilt aiipioacli is a return to 
ftiithroponvorphiein. Whal could he, however, lu the gemiino sense of 
tlip word inoic so Ilian the typiciil oxpciimcnt out of which has grown 
the concept “tiial and oiioi” is imk'cd dilTicult to imagine. Any 
cvpprimenlalion which rcIh us il.s crilnrion of succc.ss a performnneo 
demanding of an animal at least avezugc human mtoiligence is ultra- 
anthropomorphic If, liowevor, we aie to holil that an expernnent 
wliich gives the animal an ‘'e,von chance” is thus to he dasciibcd, it is 
possible that uftoi all hemg aiitluopoinoipluc is not the "crime'' it 
once, was 

Again, wo arc told tliat gestalt, or orgainsmic, psychology is purely 
theoretical — the, mind-child, ao to speak of ovm -zealous TeutoiHi 
Since nothing has been proved (so the ciiliei.sju unis) very little con- 
cern need be liad This again seems hardly fail Wein wc to assume 
such an ahsolulo standard in ouv dealing.s with scientific facts autl 
methods, piogicss would be pennaneiitly liaUod. llxpcnmentatiou 
of any kind presupposes a certain munliei of working hypotheses 
However one may u.se logic, it is diflicult to imagine an experimental 
situation not denmuding a certain viewpoint of approach which, of 
necessity, must remain in the lliooreticiil ictihii. To bo sure, any 
working hypothesis deserves to stund or fall in term.s of evpciunental 
verillcation. Until that time, liowovm', to say that corlniii n»sinnptioiis 
are valueless simply because they have, not been tested is at best a 
misconception. 

Still again the gestalt conLiibutions have been said to exist essen- 
tially in an altciation of concopta Insload of "trial and eiror,” 
"‘apperception’' or "libido” we have "insight ” “Matuiation" 
has taken the jiluce of the "slainpmg-m pioccss. ” And .so forth Itis 
true that the orgaiiisimc psychologists might give tlio name "conditioa- 
ing” or "learning by repetition” to cCilain aspects of the learning 
situation tliey would desenbe. So, too, one might call one’s office- 
chair "watci ” In the sense lliat thcic are. certain fundamental 


' Kohlci, W . "Montatity oi ApCH", Wheelei und IVikins Configuifttioiuil 
Learning in the GoldfiBlv Coiiijiaratiuo Atiino(;i<t/>ti, Vol. VII, No 1 
Marcli, 1,930; Ilclson, II.' Iiisigiil in tlio Whao Hnl Journal of JtlxpetimeiUBl 
Psi/ckoloffff, Vol. X, 15)27, pi> 378-300, 1 ewm, M II hlcmeiiLnl vciais foiifg- 
uratioiiul Ilcsponsc in the Cluck Jouinnl of I'hvermioikd Psytholosy, Vol XlH, 
No 1 
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finite constituents such a statement would be correct It would, 
nevertheless, not be true historically And, after all, a concept has 
value only insofar as there is not contradiction m its historical usage, 
Essentially, what lies behind such criticisms as those of Kuo, who would 
so to speak, "junk" all concepts, is a dissatisfaction with the tendency 
to so jumble Ihoir meanings as to make them practically useless.' 
A concept, strictly speaking, must suggest subtle differences and to do 
so it can not be so overloaded as to mean everything. As such, it is, 
prematurely, destined to mean nothing 

There have been still other cutioisms.^ Generally speaking, 
each involves a certain validity It would bo foolish to contend that 
gestalt or oi’gnnismic psychology is in any sense a perfect cieation, 
against which all criticism is misplaced As a school it is both old and 
new, theoretical, and perhaps over-ambitious So long, however, as it 
has an amplification and a fieshness of appioach, no true scientist can 
well overlook its attempts 

OBGA-NISMIC PSYGIIOIiOQY A.S A CONTRIBUTION TO EDUCATIONAL 

Philosouhy 

The discussion ao far has dealt rather auraimiily with the contro- 
versial aspects of “Gcstalt-theorie” ns a school of general psychology. 
It shall now be the attempt to analyze what seem to bo its contributions 
to educational theory. Such an analysis must, for the most pail, 
be based upon opinion and logic, since educational experimentation m 
the field 18 almost non-existent. 


' Kuo, Z Y Piyckohgtcal Review, Vol. XXIX, p 344 
2 Calkins, M W. Ciiticnl Comments on the Qcstalt-theoiie Pbyohological 
KesteU), Vol XXIII, 1926, pp 135-158 

Ilsino, H n A Suggestive Roviow of Gestalt Psycliologj' Psychological 
nevmv, Vol XXXV, 1928, pp 136-141 

Pillsbuiy, W B. Gestalt veiaus Concept as a Principle ot Explanation ni 
Psychology Jom nal of Abnounal awlSocial Psychology, Yo\ XXI, 15)2(3, pp I4-J8 

Rigntino, E Tho Psychological Theory ot Poitn Psychological Reoieu), 
Vol VIII, 1926, pp 118-135 

I/Und, P II Tlio Phantasy of Gestalt Journal o/Oenmil Psychology, July, 

1029 

WoochvQitli suggests that the S desciiptioti bo changed to icnd S — ►org 
-♦ R Tho orgnnianusls of comae mamtain that this desciiption is still extremely 
atomistic. It IS ncvertlielcss, something of a lecognitioii of the oigamsin-ns-a- 
■wliolo. 
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In Pcluciilion, if any plucp, it slionld be domrablu to conauler stimu- 
lating cucunihtaivees ns whokis We may, jierhnps, owe the develop- 
inent of the boliiivioiisHc concept '‘Btiinulus, ” m Ibo cxlfcmc isolated 
sense, to such fonmilaUon as Morgan’s law of parsimony in science 
Forever, we have been utleinptiiiK to “Htrip” experience to the limit. 
The lay tendency in tins direclion is well shown by a study of the 
beliavioiiatic reactions of callle made some time ago by Stratton' 
In tins analysis, it becoine.s appnient that there is no correlation 
between the preseiico of a rod (lag iuul anger in cuttle The anger 
icaction IS aronsed only when tlic total hitiiation is established— when 
the flag la waved in an annoying manner, when the waver jumps about, 
making peculiar vocal soiiiulfc and stirring into motion the dust about 
him 

The language field again provides an intoi esting source for examples 
of thi! inadequacy of the “simple slinmlii.s’’ tlieoiy If I piesent the 
words “Blanche White Wcikh” hi a free association lost, to a group 
of subjects including different ages ami profe.ssionH, the reactions arc 
certain to vary tremendously. To the naive, “Blanche White Weiss" 
18 not moie than a rather peculiar name To the person well trained 
in languages, it seems ns Ihiee rcpolitions of the same woid, "White 
While Whito." Between these two extremes and varying dnoctlywith 
knowledge of Preiioh, German and lOnglish, will he intei mediate 
reactions Yet, throughout, the iihyhical HlmuiluH is exactly the 
same. 

Until the teacher comes to appicciate the fact that the stimulus 
which he prcscnls exists only in i elation to the learning siliintion-as-a- 
whole, the leactioiis lie obsei vea will leprcsoiit to gieater or leas degree, 
a dilemma Only when lie realizes that a woul of suicasm, a smile of 
conlompt, or an unfair concession is bound m most cases to emerge 
from that wliole <and donnnule it, will he be aware of the inadequacy 
of independent emphasis upon some bit of Rubject-mattcr His 
ability to understand why eci'laiii “stimuli” tail to call forth ceilaiu 
“responses,” will vaiy dncctly with his coiupiehciision of a tieinen- 
dously complex situation He is not, aftei all, tlio first violinist in 
a metropolitan orchestra. He is a whole ovcht'wi.ia in himself, and 
while one sound, that of Ins one arm violin, may doiiuimle, it docs so 
only as an emerged pait of a sitiiation-ns-u-wholo 


1 Stratton, G M.' The Coloi lied and the Angpi of Cattle Pipchologtcal 
Uometi', Yol XXX, p 321. 
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Howcvei prone we may be to express disapproval of what his^ 
toncaily was "'faculty psychology, we have continued in a striking 
degree to do "faculty thinking.” We talk of "redexea” and of 
""automatic habits” We continue to debate the questions as to 
just what pails of our organizations are native and what acquued. 
In our attempt to be scientific, \vc have seen fit to study anatomy and 
physics as atomistic sciences, instead of the psychology of leaining 
A child has been eclucated in history and geometiy, not in general 
iindei standing His biology teacher has refused to aid in the correc- 
tion of his English A prcmiuin has been placed upon his accumulation 
o£ an abundance of rather meaningless data, even by methods admit- 
tedly unethical It seems we seldom stop to think that wc are 
educating a whole child, who exists as an intact organism and only as 
such 

We coirtinue to define Icarmng as "little more than the esfcablishmg 
of bonds between losponscs and stimuli,” ^ apparently naive to the 
discoveries of such experiments as those of Haller in the eighteenth 
century,- and the masterly studios of Lashley in our own period ^ 
A stimulu^s has been consKlcvcd to effect certain specific connections, 
not the whole oiganism With Gates, we have said, "When onco a 
desired leaction is made, it may be stamped in by further exercise 
until well learned, so that later it occurs piomptly and surely”*^ 
Leannng, Ihiough cxpeiionco as such, or drill, has been emphasized 
"At piesent the attitude of many toaclicis toward drill work is under- 
going a wholesome change We aie coming back to dull The neglect 
of necessary drill work has been one of the bases foi just ciiticism of 
the 'soft pedagogy^ m the schools”^ All the while we have been 
speaking with confidence of something of which, as Lashley tolls us, we 
know veiy little 

At the same tune, the human organism has been made to act 
in a fashion foreign to any otlici natural phenomenon. Ho has been 
said to learn through a meaningless repetition of muscular movenients 
Vaguely, the idea of goal-seeking, oi action towaid a point of low 
organismic tension, has been leeognized for a long time For Kih 

^Douglass, II R '‘iModcia AloUiods ui High School Teachnig ” Pp 22 
3 Ilnllor concluded tliat by tJio time a man died, he would, accord mg to the 
tiacG physiology, have to havo 200,000 impiossions foi evciy gmm of 
^Laghloy, K “Biain Mcchanianis niul Intelligence 
^ Gatos, A I “Psychology for Students of Education ” Pp 212 
^StoiiTizand, M J , “Progressive Methods of Teaching" Pp 227. 
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pftiriclc, il IS “ nmul-sot-lo-ttn-ujid ” ITn also siJgRCSts that before 
reaching that cud Ihe organism may, m lh(‘ piocrsH of choosing certain 
means "hc' loin wilhin.”* Almost nowhere, howevei, is a one given 
to nn undcusltuidniK of tiu* oigaiusiu as a pail of a naUiral scheme, 
all of which, it is raihoi logical to siipposi', is govei'iied by compainble 
laws 

Wo, have siiinihlcd linio afli>i (line in oiir iittmnpl lo explain why 
it IS that John Jones, svlio has i>uirAicivlly the snine menial capacity 
(tis inonsurod by cmiujn criteria) ns iSiiin Hinitli> does not see fit to 
“apply” himself have said, “Mam hhes to study." Never, 

iipparciilly, have we appieciated thorongidy the fact that possibly 
there IS just as even a biilujicc of len.sion in one case as in llie other 
Tor Sniii Smith, study provides the gicatest jceolulioii of a most 
complex ay.slem of stresse.s, internal and other wise John Jones, 
on tho other hand, is organized differonlly He had difforoiit goals, a 
different configuration of stii'ssos, and consequently ns a different 
whole. Both individuals function according to tlio same general 
' prmciplc^oiganisniiciilly, the Iniv of least onoigy. The thought here 
IS not new. In cvoiy hiiiguago llu're are piovmhs expiessing in a 
crude way tho idea involved. But as a point of scKMilitic emphasis in 
psychology, it is relatively new and cun, if correctly appieciated, lead 
to a great clarification in chaiacler and porcoiiality study 

finally, organisinic psychology forces educational philosophy 
to recoiisidor whellior the liedonic oouceplion, which has abounded 
smeo Socrates and no donht oven before, is after all, the true con- 
ception Is “happiness” a goal of man's activity, as such? Docs 
“practice with satisfaction explain selection foi continued usage? 
Do the veiy possibilities of altiuiiing happiness fade immediately 
ns that most abstract of till abstract things is aimed toward? If 
education is to answer negatively with the goetnlt or oiganisraic 
psychologists to these questions, tho whole view of education will be 
more 01 loss altcied. It will be broadened Tlie organism to be 
educated will be seen as an cmeigcd part of a larger whole which in 
turn, stage by stage, may bo said to include the whole iinivcisc The 
oiganismic psychologist’s “human” is a larger being, He is not an 
isolated phenomenon dopeiuling for his growth upon .some philo- 
sophically abstract principle Ho moves for the same leafaon that a 
current of air moves. For him, experience is heai'ing, seeing, and 


> Itilpatnck, W H : “ Found atione of Method.” P)j 163 
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feeling all at once He does not see ivithout hearing, nor does he hear 
without seeing He matures in the same way that any physical body 
changes He is a being “attuned to the world/' and uiuleistandable 
only ns such. 

In conclusion, it would scoin that ive can believe with Boring that' 

The piogioss of tlionght is giacUial, and the eimncmtion of a "new’' cuieial 
principle in science is novei more tlian nn event that follows naturally upon its 
untcccdcnts and lends incsontly to unforeseen consequontsd 

and still agice with Squncs: 

Kvery system has had sometlung of value to contiibutc to oin total fund of 
knowledge ’ 

If gestalt 01 oiganismic psychology has helped to claiify our 
picture of the human organism that we would educate, if it has stimu- 
lated inquiiy and application (and one has hut to examine journals in 
speech education/ music, ' and so forth^ to icalize the fact) certainly 
we must recognize that the orgamsmic school has a contribution to 
make to the theory and piacliec of education which can not well be 
Ignored. 


iBoi'ing, E G The GostaltPsychologyandtheGestaltMoveraent Amencan 
Journal oj Psychology, Vo\ XLII, No 2, April, 1030, p 308 

®Squiics, P C. A Ciiticism of the Configuratiomsb’s Interpretation of '‘Stuic- 
turnlism” Awencon Journal oj Psychology, Vol XLII, No 1, January, 1030 

»Gifly, G W . Gestalt, Bchnvioi and Speech Quarterly Journal o/ Sjicecfi, 
Vol XIV, Nov , 1028, pp 530-534; Gestalt Again Vol XV, Ecb , 1920, pp 38- 
92. 

Paiiiqh, W M Iinplicutioii of Gestalt Payehology Quarlerhj Journal of 
myeech, Peb , 1929 

Woolbort, C H Psychology fioin the Standpoint of the Speech Tcachci 
hoc at , Peb , 1930 

^Vobbei, R A Good Piactico Judgment Viohiiisl, Vol. XLIX, No 0, 
June, 1929, p. 190 

Kwalwnssci, J Music AppiccintioiiiIsItVital? Music Supervisor’s Jounuil, 
Vol XVI, No 4, Mill , 1930 

^Mooie, R and Van Wivtcis, W TIio Clnld nnd Iho Now Psychology Li- 
hroncs, Vol XXXV, Mai , 1930, pp 117-120 
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Tctu ht‘H {'ollrtti'i (’uluiiiliiu Uiiivi'irtUy 

Ul) Ui l.ln' pu'Ht'nl (uup iw Kniup lest Uus bwi\ suitable 

for Ui(‘ cliiUl in Die Iii’KiniuiiK hcliools All of the 

Ki'oup inl^lIipionOO UhIh foi (lu' l)t'|i;iuiini}>; ftuuU's lU hwuiug schools, 
such us the l)(>tioifc Fiist (Inuie, the Otis riimmy, the Pintncr-Cun- 
mngluiin, etc, make use of voflml ihn'etioUH ui giving Iho lest, and 
hciioo int5 not, hiiitalile foi the deaf On the other hiiiul, the Pintnor 
Non-lnugmige iMenliil 'r(>sl, wliieli has provinl to be well-iuliiptod for 
deaf chihheii is loo cIiITkuiU for deaf eliildieii below the age of nine or 
Ion TIenoe the inlelhgenee of yminu deaf ehildteii fioin about ago 
five to nine has not so fur lieen inensiu aide hy iiieaiis of gioiip tests 
Tlio new Pintiier Piiniiiry Non-lfiiigiiMgi) Menial Test* would seem 
to fill this gap 

Tins priinaiy non-language teal was eoiiHlmoled foi the mcnsiiie- 
raonl of intelligence below the ratigi* eovered hy the Pinlncr Non- 
laugiuigo Teat, which is of little or no tiae below (liuile II Like the 
latter, it is non-verbui in conlent and niiikes no use of liinguiige m 
tho dncctions These uio oniuetl out by means of [mnloinmc iind by 
examples of piocediiro poiforined on Iho blacJchoaiil It was con- 
structed as a non-language lest foi kindergai ton, (liiulc I and Grade 
H, so as to coimlcract any language handicap that may be present 
among young ohilclren coming fiom lioines of varied amounts of famil- 
iarity with tlio Englisli language A locent try-out of this lest in 
tW’O deaf schools would &oem to show that it has decided po.ssibilities 
as a group test foi the young denf school eliild 

The test Itself consists of four sub-tests In the fiist the subject 
has to nolo the object or picluie held up by the exunnnei and then 
find this object among the jHCtures m the lest booklet and maik it 
There are nine such items Sub-test, two calls for tho eomplolion of a 
gcometiicul form, Ihr corioct foini lieiiig al\vay.s m vh‘W as a guide to 
the subject 'L'he third suh-lest reqnueH the completion of a face, 
each item having various parts of the face omitted The last sab-test 
icquives the subject to note the position of the anus of tho examiner 

’Published by the Uiiiemi of I’uhliciilioiiK, 't’enclieiH t’olloge, Coliiinhia 
"Universiiy 
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and then draw them m the conect position on the appropriate picture 
of a mnnikin in the test booklet The test is difficult to give and 
rcqiiiies much preliminary rehearsal on the part of the examiner, but 
when given propeily it can be understood by children entering school 
for the flist time either in the kmdcigarton oi first grade, 

This tost was given to the lower grades in two schools for the deaf 
for the puipose of testing its suitability foi the young deaf child,i 
Practically all of the childicn in the lowest giadcs in both schools were 
tested and a sampling of older chikUcn in older to see how fai up the 
test would bo disciiminativc In all two lumdied ninety-three chil- 
dren were examined, ranging in age fiom age four to age fifteen. Table 
I shows the fiequcnoy distiibiitioii of the scores by age foi all ehilclien 
tested, Tip to age eight mchisive the cases aic faiily well scattered 
ovei the total range of scores; but from age nine onwoids the eases 
begin to be bunched at the upper end The median scores lise steadily 
from age four to ago nine, whore they reach a level It is obvious, 
thci'cfoie, that the test is too easy for age nine and above The lack 
of zero scoies at any age would seem to indicate that the test is not 
too difficult foi the oidiimiy deaf child duiing the first few yeais in 
school It would ,sccni, then, tiuil wo have here a test suitable for the 
young deaf cliild between the ages of four to eight, a period of develop- 
ment not covciccl at present by any other suitable non-language group 
intelligence test The content ot the test piovecl of interest to the 
childicn The icachots of the deaf children commented upon the 
suitability of the content and piescnlation of the test foi deaf children 
So fai thi.s tost has not been adequately standardized on heaimg 
ohildien, but a compaiison of the deaf children’s scores with the 
tentative norms for the healing may be of inteiest The results up 
to the present time tivc as follows. 
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* Tlio writer wishes to nclcnowlctlgc the splendid cooperation oE Dr Hams 
Taylor of the Institute foi the Improved Instiuction of Deaf Mutes, and of Miss 
Came Koaina of P S 47 , Mniiliattnn Two giaduato students, Mi Cliestei 
Bennett and Miss Elsa Itichnids liad charge of the testing and the wiitei is indebted 
to them foi thou eaicful woik 
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'L’Up hipiU hcdip foi Iho fivcjypiu-old dctif is lui'^pd upon only nine 
eases and llie^e inolmbly aeinVsciit a veiy suiienor Rump At the 
other three »(?es, where wi* have a heUm »iiin])hnK of deaf children 
the acores mo uboul. llie, mime as (hose for iKMiriiip; chihhen Ting 
result is in inaiked coiilrnal to niosl (joinpaiisons between the deaf 
and hearniK on Ri’oup iiifeilif'enee IchH, wJieie Ihe deaf aic usually 
veiy far beJjind the hearinp;. I( may be that our tentative norms 
for tlie liearinp; me too low, or that I lie deaf cluldreii tested area 
much Biiperifli HiimpliiiK to dLSif ohildien in neneial Furthei work 
with both (loaf aiul Ucurinp; ehildieu will clear up these points. 
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There 18 another posaiblo oxphuialion for thm equality or superior- 
ity of the deaf child on this IchI One of the examiners, Mi Bennett, 
believes that the deaf child has an advantage over tlic hearing child 
mnsrauch ns his whole training leaches him to pay more attention to 
gestures, facial expression and the like, and hoiico ho is better able 
to mterpicfc the pantomimic mstructions of the cxaimnei and profit 
moic from them than the hearing child docs 
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A gioup intelligence test for young children has been constructed 
which IS pi esented by means of panloinime and examples on the black 
board. No language is rcqiniod to imdcistand the diiections oi t( 
respond to the tost items. J3y means of this test it ig possible to tesi 
young deaf children m schools for the deaf It is the fiist group tesi 
suitable for such cases. The results so fai obtained would seem t( 
indicate that it is diseriinmative for ages fom to eight inclusive. Tht 

deaf child! en so fiu tested slightly exceed the tentative norms for the 
hearing 



^YIIAT TS anCANl' A f/ I^VCTOll? 

TIUJMAN 1, Kl'XTJCY 
lljn vml 

'riut puipOM' i>f this nilHih' is in ilisi^uss wlnii onnstiUitos the proof 
that ii cointnon faolor jh .sufiicjnit in fU'roiiiU f(ir Hie nUorconelaiions 
boUveon u number of vunabh's 'V\w iiiulieular oceanion foi U if, the 
article by Piofobboi IIolziiiKer^ iii which ho uses certain clala of mme 
as followa: 

Uy way of ilkihtraLing Uioso i}Oials, wo may lake an o\ainplc fiom Professor 
KeHpy’flbooVc (p ttVH ) Tito fom iisaci are 

-Yi Uoadimi; spend 

-Vs — Authiiioiio powni 

Xn — Menioii for ^vonlw 

Xa « Moiiioiy foi inraniDgnil HyrnholH 

Tiio iiiteroonelftiion and Intiacl difTnrnnnts aie as lak(*ii fiom a paper by tho 

wilier,* 
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From tfio iiiaignificanco of tho so tetrads \vo may conclude that factor pattern 
(1) with only \} common iw HUttimcnUy complex. If group factoiH aic picsniit in 
these foui tcrtla thoir nlTect jh iiiHigniriennt, ynt PiofrHSOi Kclloy einjiloys tho pattern 
giYQn Uy iUo following poiUon of hw 'L’ahln XU (op cd ), NuiuU'mh m tho tabic 
are ataiidaul deviations 


1 lIolssingGi, K, J Thoinddco’s CAVD U Pull of O The Journal of Educational 
Pmhology^ Mareh, 1031 

*llobingoi, K, J, On Tetiad Diltcienpcs of Ovcilappmg Variables Joumal 
of iJdwcatianol Psych olopy, Feb , 1029 
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This happens to be a voiy false presentation of my argument and 
findings because tlic other elements m the pioblem have not been 
taken into consideration It is totally unsound to investigate foui 
variables, find that a single underlying factoi is sufficient to account 
for the intercorrelations, and conclude that the same underlying factor 
(or any other, for that matter) would account foi the inteicoirelations 
of those variables when employed in connection with variables other 
than the four Awareness of this is fundamental to a study of mental 
analysis, and that Holzmgei has overlooked it both in connection with 
Thorndike’s interpretation of CAVD and my interpretation of my 
tests 18 unfoi innate because it confuses the issues involved 

A brief presentation of hypothetical data will, I hope, make the 
issue clear Let us bo given the following eight tests and let them 
be totally accounted foi by five underlying independent, i e,, uncorre- 
lated factors labelled a, b, c, d, e, as shown in Tabic I The constants 
are designated by hteial symbols, othei than -c, with subscripts The 
chance factors that ordinal ily enter into measures have been omitted 
meicly for the sake of simplicity of picsenlation 

T^tild I 

a, = ?nia + riib 

Xi — niia + OiC 

X] = insfi + J>3fi 

X4 = 

aJs = mi,a + mh 

Xu — “h Stth -J- OfiC 

Xj = -1- d* Thd 

Xs — H- nth + ^tS 

With vaiiables 1 to 8, duo to undeilying factoi s ns given, it can 
readily be shown that the tetrads involving variables 1, 2, 3, 4, will 
equal zero, implying that one underlying factor is sufficient to account 
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for the intcrooirclatioiia This is tnir but the intorconelatioiis 
accounted foi itro > ,5, r,,, ? n, jjj, I21, rn, anil iioiio other. The correla- 
tion 1 16 la not accounted for Viirmblc 1 bus just as much "right" 
to be con.sidored in connection with vuiiablo u us in connection with 
vaimblos 1 , 2 , 3 and -I Dr nolziiiffer's use of my data is equivalent 
to ubslraclinp; from a table, auch as Table I, the first foin rows only, 
and then pointmjr to the luck of evidouce of factors b, c, d, and e 
Certainly there is lack of evidence in the first four row.s, but there is 
no luck of ovidciicc m the tidilo cnliic 

Consider tbo data of Taiile I Ali of the totiads involving 1-,, 
ajj, ni equal zcio, and .secoiully all tho tetrads involving Xi, z,, 
xt, also equal zoio. Clearly one underlying factor is sufficient to 
account for the correlations between the first four vuiinbles Let 
us call this factor g. Clearly one underlying factor is sufficient to 
account for tho coiiclations between the last foiu variables. Lot us 
call this factor {/. The next thing is to say that g =* (/. As a bit of 
verbalism it sounds reasonable but ih, in Uuth, absurd. Tho fact 
tlint one invcatignloj’ fiiulH a single underlying factor sufTicicnl m a 
given set of tests, and a second finds a single iindoi lying fiictoi sufTiciont 
in ft diffcient set, is not evidence at all tliat the two fiiclors aro the same 
In the Tabic I illiialuUion they luc eutiiely (lifTeicnt, being an 0 factor 
in the first four tests, and a h factor in the last foui. To generalize 
from tho relationships found in four tests to rchilionsliips supposed to 
lie in the mind of man bog.s tho question, for doing so involves tho 
assumption that llio foin tests siimplo the entne irienlnl life. There 
is no corlftiii tcclmiquo which lovcula the luttci, but tho more oKtcnsivc 
in number and varied in uiiluie tlie testa employed, the moie hkeli* 
hood that the relationships found to uiidoilie tests scores will icficct 
relationships m mental life. 




W N KELLOGG AND B. M BAGLESON 
Iiidiaufi TJiuversity 


r OuTLmE OF THE PROBLEM 

Oi tho Lumei'Oiia aUeiRpts to uncover racial differences between 
negroes and whites^ the possibility of a distinction in the ability to 
interpret facial expression seems paiticularly fruitful It may be 
aigued for example that negroes should he less able to understand the 
emotional expression of wlnie tndividuals because they have fewer 
opportunities as a class to observe whites in emotional situations. 
They ^YOllkl correspondingly be supposed to be superior, however, 
in comprehending the expressions of the negro countenance. On the 
other hand, an ability surpassing that of whiles m the interpretation 
of emotional expression of all sorts might theoretically be ascribed to 
the negio as an outgrowth of the gicater propensities for emotional 
behavior which ho is generally supposed to possess 

One of the most direct methods of approaching such a problem 
IS to delermine at what stage of development differences, if any, 
begin to appear. This can bo done by examining groups of children 
of each raco, at varying ago levels, equated as nearly as possible 
m icspcct to mtolhgence and social status. G, S Gates^ has alieady 
reported an investigation of the growth of social peiception in four 
hundred fifty-eight white children fiom three to fourteen yeais old 
Smee liGi method is simple and the groups are carefully doscribed we 
have taken hei lesults as lepresontative for white children, and have 
duplicated the expenment as nearly aa poasible upon similar groups of 


^ The wi iters avjsIi to acknowledge the geneious cooperation of the following 
poisona, whose assistance in guintmg permission to enter the various schools and 
whose suggestions in the selection of different social groups arc sincerely appreci- 
ated. Mr Daniel T Won, Acting Sup omit endent of Indiaiiapoha Pubhe Schoola, 
Mrs Grace L. Blown, Siipoi’iiitondGiit of Indianapolis Kmdcrgaitens, Messrs, W 
N Giubba and E, W Digga, pi mcipalfi icapectivcly of Public Schools 24 and 42 of 
Indianapolis, and Ml Antlioiiy Courtney, Principal of the Bannekci (negio) 
Public School 111 Bloomington, Indiana 

* Gatea, G S * An ExpcTiiuental Study of the Giowth of Social PcicepUon. 
Journal of Educational Psychology^ Vol XIV, 1923, pp 449^461 

307 



H68 


77u» Jomunl of JCdunifinual Paifchologtj 


iioginc's. Tiic tochiiKiiin ailopUul l)y UalrH iuis linon Tollowod meUcu- 
loviBly \\\ oulcv to make* Uie fuukoRs vtiUtUy compavablc to those she 
repoi Is The only facLor wlneh remains nnoonlrolled in oiu* procedure 
is tho grographioal difference in llie locations of tlic negroes and the 
%vhiL(‘a That this has introduced no spunons iiihiKuices will appear^ 
we think, from the reHiills. 

II, JCxiMnilMIvNTVL CklNDlTIONB 

]\IaiGnah — Six pictures of the face, head iiiul shoulders of a 
woman in vniious omolional poses weie selecLod from tho scries 
publtshod by Huckmick ^ Typical mtoiproUitions given by adults 
to ouch of these picUues are uh follows “ 

Pictuic A — ^Ijaughter, joy or amiUiorneiil 
Picturo 11 — Pain, 

Piotuie 0 — AiiROi -or clellan-co 

Pictuio D — l^oar oi lionoi 

Picture E — Seoul, eonloinpt or disdiini 

PiQturo F — Surpusc, woiidei iir iuna/5enient 

The prints wore presented ‘^singly and nulividually*’ by a negress 
cxpcinncntci. liaco and hex relalionHhips bi'twoen cxpcriinenlcT and 
subjects wore thim eqinvahmi to those between CJaies' subjects and 
experimenters It should be iiob'dj however, tluit llio emotional 
picUiios were identical in both sludioa and that they woio poses of 
a while woinan* 

Method — After piclimmavy offoits to put the subject at case, 
his name and ago weic asked School grade and sex wcio recoidecl 
at the same time. The ejcpciimonler then bind (1). ^T am going to 
sliow you some picluies of a lady, and 1 want you to tell me what she is 
doing. If no response, or if an incoiiect or doublful icsponse was 
made the subject was asked (2)* ^‘What is she thinking aboiifi^^' and, 
after a irnuae (3): *TIow does she feel?'* Ilephca to these questions 
were recorded verbatim. 

Tho problem of grading uud classifying the unswers accurately, 
particularly those of the younger children is, as (hitea has pointed out, 

'Iluokmiclc, C, A: A Prohmmaiy Study of llio Eino lions Psyc/iofopical 
Monographs^ 1921, Vol XXX, No 130 (Critical and E\peiirnGiital Studies 
m Pflychology from the Univcipity of lllmois), pp. 30-36-* 

^ Cf either lluckmick oi Givtca; Op cii. 
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a difficult one, We endeavored, however, to adhere stnctly to the 
criteria established by her Those responses listed ns coirect ol 
incoriect for white children were similarly classified throughout this 
experiment A few answers were leceived, however, which Gates does 
not report, in these cases “any mterpietation which expressed the 
general trend of feeling in the pictuic was counted coirect 

In scoring, the piinciple of giving the subject the benefit of the doubt 
was adopted Thus when it had been necessary to ask two or three 
of the expeiimental questions the answer to one of which pioved accept- 
able, the subject was allowed ciedit foi his best answei unless replies 
to the lemammg questions clearly indicated that he had no compre- 
hension whatsoever of the expression pictured 

Subjects — Thiec hundred thirty-Lwo negio school children whose 
ages ranged fiom thiee to fourteen years were selected for this study 
from as widely varying social levels as were available in the vicinity 
of Indiana Umveisity The total number employed was divided about 
equally between boys and girls Ninety-three of the gioup, represent- 
ing all social strata, came fiom the only negro public school in the city 
of Bloomington, Indiana, a communityof approximately 18,000 popula- 
tion Of the remaining subjects, ninety-eight weic taken fiom Public 
School No 42 in Indianapolis,^ which is located in a middle and xippei 
clasB negio district A third group, numbering one hundred eight, 
came fiom Public School No 24 of Indianapolis, which was chosen 
as representative of the middle and lower stiata of coloied families, 
Children of ages three, foui and five were tested in the Flanner House 
Kmdcrgaiten and Day Nursery and m Kmdcigaiten No 4, both of 
Indianapolis A rough classification according to intellectual ability, 
as estimated by teachers, was obtained foi all subjects six years and 
over m ago 

By these selections the authors feel that a fair sampling of various 
social and environmental levels of the typical ui ban colored population 
has been obtained 


III Results 

Conopaiisons between llaczal Groups . — ^Thc summarized findings 
foi all subjects, regardless of social or intellectual status are given in 


1 All the schools visited were exclusively negio institutions, including teacheis 
and piincipals 
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Table I. Fifivivi'S ot this table me the pm cents of coirect mterpreta- 
tions, pictuie by picture, {irranged iicuording to the ages of the respec' 
tivo BUbjCCtfi 

Aside fioin nunor viuiiitionH the, data indicate bubBlautially 
the same facts brought out in fiales' stiuly of while childien, namely, 


'Taiu.m I - Pull OnUTH or' (’oaum t Uksponbi.h pi.u Pictoiii! roii TuncK IIundheo 
T niim-TWO Nb(<iu> t'-imanum 
(All Groups Combincil) 


Agoa . . 

3 

4 

6 

0 

7 

8 

0 

10 

11 

12 

13 

14 

Picturo A (laugh Icr) 


rf) 

,80 

87 

73 

83 



88 

04 

86 

01 

Piotuio B (paiu) 

00 

HQ 

4/5 

.r,o 

08 

70 

80 

01 

72 

.01 

,74 

83 

PicLuic 0 (angor) 

■ 

,13 

mm 

47 

,/>! 

Hul 

02 

70 

78 

87 

88 

,06 

Pjotuio D (fcart 

H 

HTti 

.16 

Hg 

30 

37 

ni 

07 

72: 

74 

86 

74 

Picture E (Bcorii) 


00 

00 


oal 

03 

00 

00 

13 

10 

,18 

,17 

Picture F (BUrprlsG) 

00 


00 

00 

Hu] 

HQ 

,11 

.12 

26 

35 

20 

34 

Number of cnhca 

c 

8 



37 

30 

37 

33 

32 

si 

"34 

35 


(1) that the percentage of suecossfijl rospoiiRca twids to increase with 
ago xegardlojss of the cmotionul expio&Mon jvulginl, iiiul (2) that the 
gcncial order of pciceptibdily is, with ocoasionnl exceptions, as 
follows : Laughter, pam, anger, foiiv, Hiiipiise and scorn. The per- 
cotttnges of siicces.'iful responses of Ihe iiogio childicn exceed those 
of the while cliiklron (as shown in Gatos' 'I’uble V, p 4G0) more times 
in the mlorinetation of the Picture 1) (fear) than with any of the 
other expressions. It is doubtful, however, if any pnrticulni sigmfl- 
canco should bo nsciibcd to tliia ie.siilt. The findings on the whole 
arc stiikuigly similar in the two expenmenta 

One point of some significance wliicli iipponis ui the figures of 
Table I is tlio tendency of the pcicentages to drop for many of the 
pictures at ages thirteen and fourtocn. An oMimination of the 
analogous data for while childicn brings out the same sort of decline at 
the upper ages. The drop is probulily to be uccounled for, wo think, 
by tho fact that the older children who remain in school (whether white 
or colored) icprescnt tho loivei iiilelligonco IcvoIh foi tlmii ages, and 
Would consoqucnlly ho expected to bo infcnoi in social perception 
when ooitipaiod with subjects slightly younger than themselves 
In Table II wo have recomputed Gatos' pcicentages foi white 
children, combining the results for nil six prints, i e , without considera- 
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tion for the emotion depicted. These data arc heie paired with the 
similar figures of the negro childien '■ 

TADI.B II — Pbh Cents op Successful Responses op Whites and Neoeoes 



AGB tft YEARS 

Pig 1 — Growth ourvoa showing scores of negroes and whites as giym in Tablo II 
The flcorea of the whites aro not consmtontly suponor to thoso of the negroes oxoopt 
at the younger ngoa whoro the white subjects wore highly solectocl (aeo text) 

Disregarding for the moment, the percentages below year five, we 
see that m six of the remaining ten age-groups, the values obtained 
by the coloied children eiihei excel those of the whites or approach 
to within two points of the results of the whites There appears 
therefore to be no obvious tendency for the sanaples of either race to 
be superior to those of the other in this ability.^ The peicentages 
foi years thi‘ee and four are not validly comparable since our figures 


^ The poreentagea weie computed by dividing the actual succesaea, legaidlcss of 
the type of e\presaion judged, by tlio total posaible successes (=^ the number of 
cases X 6) 

2 The icliabilities of these dilTcrenccs wore not obtained 
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were obtftinccl from average coloicd childi’Gn while iho majority of 
Gates' subjGcls of these ages came fioin KindcrgarLcn of a 
select private school." 

Intellechialj Sei^ and Social Clasjitficalions — Percentages in Table 
III {vide tnfia) were oblaincd m the mannor as those of Table 
II, except that tho data were subdivided into thieo classes accoiding to 
teachers’ efitimaics of tho intelligence of tlic children 


Table III — Vm Cents of Succkbses of Giioups Classified AccoiiuiNa to 

iNTBLUdUNCU 
(All Schools Combined) 


Ages 

0 

! 7 

8 

0 

10 

11 

12 

13 

14 

Group X (sup Cl 101 ) 










Per cent 

33 

44 

40 

53 

GO 



73 


N 

Group Y fjiviuago) 

8 

12 

0 

12 

13 

13 




Pci cent 

31 

44 

GO 

54 

GO 

58 




jV , 

Group Z (inferior) 

12 

11 

10 

15 

0 

11 

12 

12 

10 

Per coni 

30 

29 

33 

45 

58 

40 

01 

57 

.54 


lo 

14 

11 

10 

11 

8 

9 

12 

16 


Group Z, with few exceptions, ia lower in social peiceplion at 
all ages than either Groups X or Y Group X shows little supenority 
over Group Y except in tho later ages, namely, cloven, twelve, thiiteen 
and fourteen. There thus appears lo be a positive retationship of a 
crude sort indicated in oiu figures between social peieeption and 
intelligence. The failure of the X group to demonstrate its supeiioiity 
over the Y gioup at the younger ages is probalily lo be explained as 
a function of the inaccuracy of our method of measuring the 
^intelligence" of these subjects 

Accoidmg to Gates: ^^Sex diffei cnees are not manifest and diifer- 
cnccs caused by social status, il they occur, aic slight " This applies, 
of course, to her experiment with while olnUlrcm, No hguics aic 
given to substantiate those slatcinonU Our own icsiilts, howevci, 
indicate a rather pronounced sex diffoionco, as shown m Tabic lY. 
The boys arc supcrioi to the girls only in tho younger ages (where m 
moat instances tho number of cases is small) rioin seven to fourteen 
years, on the other hand, giils exceed the boys. This supeiiority is 
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to be explained no doubt as a result of the more rapid maturing of the 
girls The female subjects, actually m a moie advanced stage of 
development than males of the same age, would hence be capable 
of bettei performance jn mental tasks 


Tadle IV. — Peii Cents op Shccehses op Nbqiio Bo^s ps Neoko Giiils 
(All Schools Combined) 




flee m yeflos 

Fig 2 — Growth curves showing relative scores of iiogro girls and negro boys aa given 
in. Tablo IV Above ago 6 the scoteta of tho guls doiuonstrate a consiatoiit tendency 
to bo Bliglitly liiehor tlmn tlioso of bo>fl of tho same ngoa 


Differences between the majoi gioups of the three public schools 
arc indicated in Table V Two rather stiiking facts appear fiom the 
data m this table* (1) The subjects fiom the Bloomington school are 
superioi to those of cither of the other schools in five of tho possible 
nine age-gioups, (2) the subjects from Public School No 42 (presuma- 
bly from average to superior social levels) exceed the other two groups 
at only one age 

A compaiison of the two Indianapolis schools, year by year, dis- 
closes that neither is consistently supeiior to the other The subjects 
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from these two schools were specifically selected, however, because 
of differences in enviroiiinenlal levels It is indicated, ilicrefoie, from 
these figures that chstincLions in social slrala aie of minor significance 
in the development of social perception The general supeiioiity 
of tlie Bloomington children over the otlior groups can be accounted 


Taule V, — Pnn Gi-.nth of Coiireut llrnroNsns lou Dipfhjiiknt SoctaIi Gnoora 


Ages 

0 

7 

8 

0 

10 

11 

12 

13 

I 14 

BlODHEEgtOn 

Per cent 

29 

35 

48 

60 

60 

.06 

76 

08 

60 

N 

7 

0 

10 

12 

11 

11 

8 

12 

13 

Indianapolis public school 
No 42 










Per cent 

.3a 

30 

,42 

51 

66 

,60 

.03 

UO 

,83 

N 

n 

10 


13 

10 

10 

10 

10 

10 

lTi<lian.apQli8 public scKool 
No 24 










Per Cciit 

31 

40 

30 

63 

64 

68 

61 

01 

60 

N . 

12 

12 

12 

12 

12 

11 

13 

12 

12 


for by the fact that in this email school two or three giadca are kept 
together in a single classioom* The continual contact with those 
older than themselves, afforcls the children gi enter opportunity to 
become adept in social perception than would be possible if they were 
segregated in separate classes. 

IV Summary anu CoNcnufcioNs 

Following the procedure adopted by G S. Gales for measuring the 
growth of social perception in white childicn, three hundred thirty-two 
negroes varying m age fiom three to fourteen years were similarly 
tested. Six pictures of the Ruckmick senes weie presented one at a 
tunc to each subject who then attempted to incUcate the emotion 
ropresented- 

1. Regardless of geographical difforciices in the location of the 
whites and negroes undci examination and the fact that children 
of both stocks judged facial cxpicssions jioscd by a wlnic woman, a 
striking similarity was evidenced year by year in the data for the two 
racial groups, 
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2 The growth of social perception in negro children was hence 

-"■oh 

e JpUUhT™/ i „r“ 

4 A rough positive lolationship appears between social perception 
as measured m this cxpoiiment and teachers' ratings of intelhgLce 
6 Groups of diffeient social status manifest no superionty L the 
mteipietation of facial expressions which can not be explained by 
factors other than their respective social levels ^ 



ON KIN RKSICMIJLANCES IN PHYSIQUE VS. 
INTELLIGENCE 


ilElinEllT S C’Ol^llAD* 

Inwtitutc of Child WolfiiH*, UinvorHity of Ciiliforiiia 

A mimboi’ of aliuhos have pointed out tlio fsimiknly of fanoilml 
coefiicicntH of nwinhlance in pliyhiciil unci in mc'iilal tiaits Tlie 
inference, liy annloRy, is usually tlial, tlio menial liails aio inherited in 
the same ivay and to iho same extent, as the pliysical ^ As a possible 
objection to Ibis, Spearman lonp; ago pointed out that the physical 
cocflicicnls of i cscinblance me lelalively unaltemiatod by the uniclia- 
bilily of nieivsvivemcnt; whereas the inontivl coelhcionlb arc probably 
considerably attenuivtod.'® One of our leading investigators in this 
field has lecciitly found the leseiubluiicc of siblings in intelligence to 
equal a coiTdiition of .00 (coircctcd for iittenuation) He concludes;” 

If wo nmy iiceept I’eai son's lesnllH foi tiic lescinhlniice of sihliiiRh in eve color, 
Imn coloi, find cophalie indcv {!) 2 , 55, and 40), and logard 52 £ 010 m the 
rosomldmicc m traits cnlirely b ec from eiwiron mental uifluonca, w o m ay infer that 
iho injliicnff upon tnlellt^enrc of .vich wnn/onf?; in omroimirnl ftn t.i caused by being 
eibltni/s Im to Joitr yeais aixul tn age w an AmeiicaiiJattnhj to-day is to ram the 
coirelaltoit ftom .1)2 to (H) f 

This conclusion, while possibly collect, can hardly be accepted 
solely on the ovidence piescntcd by its author The measure of 
intelligence employed, consisted of “a selection of tests from standard 
instriunonts — the Institute of J'hlucatioiinl Rc.seaich Tests of Selective 
and Relational Thinking, Gcnciulization, and Oiganizalion Now, 
if the luithoi had taken a single icU fioin. lus total lutcIUgeucc battery, 
and compared the correlation of sibhng.s in thts lest with the correlation 
of siblings in (say) eye color, the comparison might have been 
accept able Eye coloi is, apparently, a iclalivcly simple trait, dotei- 
mincd by a small number of gciio.s, and perhaps the scoip ni a ungle 
test appioaches gcncLict coinparahility; but the total score in an entire 


* The inanusciipt lias heimfited hoin llie culieiHin of Di Hoheit C Tiyon, 
National Ueseaich l'’cllo\v at the Uiuvoisity of Cnlifotnm. 
t Italics ns 111 the original 

I Thioughout this paper, the woul "geiictic” m used in the biological souse ol 
“hereditary,” or “pcTtaiiung to genes,” nevci m the scn&c of “poitaming to 
development,” as lu the teim “gonclic psychology ” 
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mlelligeiice test is almost certainly too complex, for a comparison with 
eye color to be genetically significant. Most students of the constitu- 
tion of mental traits, from Spearman to Thomson to Kelley, appear 
agieed on at least one point* that the total score on an intelligence test 
represents a composite (with unknown weights) of several more-or-less 
intellectual abilities, or traits The statistical effect of merging several 
component tiaits mto a general, composite tiait like '‘total intelligence- 
test scoie'^ 18 ^ m general, to increase — and, so fai as the comparison 
with simple physical traits is concerned, to symiouslij increase— the 
correlation between siblings in the general trait A precise evaluation 
of the spuiioiis use im correlation may be secured by applying Spear- 
man^s foimula for the correlation of sums and aveiages ^ 

Let us, for example, suppose that the average con elation between 
siblings in. each of eleven scpaiate tests la 52, that is to say, 

7ji — .52, T 211 = 52, rgiii = 62, • - * ?’//xr ~ 52 

This coefficient coincides with the average found by Pearson for 
certain physical tiaits (eye coloi, hair color, and cephalic index) 
Now let us add the eleven tests to form a single battery or "intelligence 
test ” What is the conelalion between the siblings in this total 
battery? If the average mtercon elation between the separate 
tests (foi the identical individuals tested on the seveial tests) be 80, 
and if the aveiage of the "cioss-correlntions" be .37 — then, applying 
Spearman’s formula, we find that the correlation between the siblings 
in the total test is .60 (see Table I) Would this increase fiom .52 to 
60 repiGScnt, ns appeals to have been argued, the effect of envuon- 
ment, or would it lather repiescnt a necessary statistical outcome of 
the combination of individual tests into a composite total score*? 
Obviously, the coefficient of km resemblance which one obtains for 
"intelligence'’ dej)ends to a marked extent on the mmher of tests which 


* Throughout tins illustration, all 7 's as given mo assumed to be freed fiom the 
attenuation duo to iini ell ability of measiiiement 

The notation which follows is somewhat similai to that of Kelley ^ 1 icfcia 
to Teat 1 administcied to the peisons in the X-distiibiition; I lefcra to the same 
test administered to the siblings of the peraona m the X-disfcribution i rii is thcre- 
foie tlio con elation between siblings m Test 1 Siinilaily, r^n is the con elation 
between siblings in Teat 2, etc In like fashion, rtu would mean the '^cross-corre- 
lation" between the scores ol persona in Test 1, and the scoreg of their siblings m 
Test 2j would hove a similar meaning foic' the aibimg cross-CDTi elation in 
Tests 2 and 3, etc. Seo Table I 
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me merged i?iio the tolo.1 “ intelhornce" score, and the znlercon elation of 
these tests. With a aiutablc hatlcry of tests called "mtelligonce” 
it Boems that uluiost any dogrcc of Biblmfi resemblance might he 
obtained.''' 

Tabw) I — Thu (!oltUBI^ATI(J^^ iii-.nvi-.nN Sihmnoh m a Totai. lNTBM.taBNOB 

'I’EhT, Dl.TnuMINKI> VftOM 'tlll.ln CoiOOa.ATlON IN THK yi.l'AUATB SOBTESTS 

i/)(i+ue ..xn Va.|-(a>-n)f„V6 + (6VCly^,' 

(/ + /S -j- * //) moAiiH the sum of fclio sroioa iri the eleven tests, made by the 

poisons m the A'-distubutioii 

(I + II -h * < XI) meaufi fchomimof tho«coiosin t)iOHfimo cloven tcsts,nuidoby 
the of tlic porsouH lu X-diBttibutioii 
qr = ^ « juunbci of tests 11 

fpq ^ tlio avorago intorcorrelnlioii hoLwceii the tests, for tlio pciAons in the A'-dis- 
tnbu bion 60 

fpQ ^ tliQ avorago mtorcouolatiou hetweeu tUc toste, fot the persons in tho V-dis- 
tribiition *= GO 

fp, IS assumed to equal rpqt m this ense, Ijocausc the same tests arc involved, only 
tho aaniplo receiving Ibo tests differs nominaUy. (The aamplo from which 
T j'Q \R ob taincKl consiBts of the siblmge of tUo sample from which is obtamed .) 

fpQ ^ the avorago of: m + ^in + + H- ^/xi + 

H" + j^xi 

• +?5i + >^511 + J’siii + “h >5X1 + + + 

liju -b Turn + ’ T'lixi 

(There arc, m all, 11 coodlcionts of couelatiou with subsoripts hko II, ;3ir, 5lII, 
j^IV, etc., each of theso conelatious equals &2* TJioio me 110 coefficients of 
correlation with flubsenpts like ill, IIII, iXI, 21^ , i^XI, 51, 5II, 

STV, » . SXI, otc , tho averago of these 110 '‘cioss-correifttions/' by the assimip- 

tions of tills illustration, equals *37 ) 

’(/+?+ .ro(t+iH x« “ 

« 00 

* Some illuBtrations of this from exp on mental studies me available. Starch, 
for eytunplc, Gndfl tho average coviclation between oightccu pairs of adult aiblioga 
in toil separate achievement tests to be 42; in fivo scpaiato mental tests, the cone- 
la tion IS ,G8; but in all fifteen tests combined, tho con elation is 731 Soinewlmt 
similaily, Jones’^ finds tlio con elation between single parent find single child to 
equal .648; but tho couclaUou of mnUpiueut with mid-eluld (civciago Bcoro of all 
tiic childiou) IS .051, Willoughby/® nniking iiao of hcoics in siiiqIq leuls only, and 
coivectmg for ationiiation, repor^ts an avcinga sibling coolhcicnt of .42; tins, as 
Toiman lemaiks, is “out of line with (lower than) the lesults of other inveskiga- 
Tlieae “oilier lUvcBtigators” have, m general, used total vuteUigeuae test 

scores, 

I CJ Heferenee 6 
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It IS evident, tlien, that to measure a functional complex, like 
^^intelligence,” and to assume this complex as a genetic entity,* 
may involve statistical difficulties Of course it is impossible, in the 
realm of mental chaiacters, to measure the strictly anatomical struc- 
tures to which the genetic entities most probably correspond The 
point here is simply that tho (different) ability complexes which are 
measured by (diffeieni) intelligence tests are not, in any likelihood, 
the junctional coimto farts of genetic entities Intelligence^^' as 
measured^ demands analysis Prom this point of view, the mathe- 
matical studies of Rosenow,^^ Spearman, and Kelley® would 
appear of a fundamental nature, and not as oh2ets d'ari It is, 
however, unfortunate that these useful and stimulating mathematical 
contributions have not more specifically considered genetic pioblcms 
and mechanisms 

Another statistical misunderstanding deserves mention. In re- 
viewing the literature one occasionally finds the statement, or somehow 
secures the impression, that because the coefficient of correlation 
between kin IS 20 (or 30 or 40, etc), the evidence for kin-regemblance 
IS strong 111 truth, however, a correlation of ,20 or 30 or ,40 is indiea^ 
tive not of strong similanty, but of fairly stiong dissimilarity A 
more legitimate asseztion from these corielations, peihaps, is that the 
evidence for heredity is significant. As a matter of fact, however, 
at least in the realm of mental traits, nobody knows (except by doubt- 
ful analogy with physical traits) what correlation should be expected 
between km, if heredity alone were the cause of resemblance. Nobody 
knows, because nobody yet knows (except very hypothetically) 
the mechanism of mental inheritance t Serious argument from 


* By “genetic entity “ the writer means a $ingU elemeniary trait which is caused, 
in part or m whole, by a specific genetic mechanism — ^i-vhethei unit-factor or 
multiple-faetoi Thus, uihaie /oi clock is a genetic entity (probably nrvit-fnctor) , 
but handsomeness is not a genetic entity, because (like intelligence-test score) it is 
a complex trait composed of several individual (and arbitrarily weighted) entities 
tR A Fisher^ and Sew all Wiight^* have postulated ceitain coeflicienta of 
phenotypic resemblance between kin, on the basis of certain assumptions coiiccin- 
mg the mechanism of heredity Some of Fisher’s assumptiona (paiticularly as to 
the mimbei of genetic factors involved) may be doubtful m themselves, nnd Fisher 
himself admits that his whole set of assumptions may be over-simple (such possible 
phenomena as lethal factors, somatic mutation, environmental effect upon domi- 
nance, diffeiential fei biLity of gcims, sexual selection, and the coi relation of heiedi- 
taiy and enviionmental factoie aie ignoicd) Wright gives the most complete set 
o£ predietiona known to the wntei, but these piedictions aie based upon definite 
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empirical corrolation confliciontR alone, therefore, Reems as yet unjustU 
fieci To give extreme examples for the cmpliams of this point; 
The corrolation between parent and atTspnng foi trait X, in a pure 
inbredj homozygous line, would (if the parental envnoiimcntal factors 
aic uncorrohiLed with the offspring's) lie znor- And yet this absence 
of correlation is consiBtent with a quite piofound infiuence of heredity, 
which, indeed, could never be deduced from the zeio coi relation 
coefheiont alone, even if statistical allowance wcie made foi theicBtric- 
tioii of range in an mined population CJonvoiscly, the correlation 
between tuberculous infeclion in parcids and tubcrciiloua mfoction 
in ofTspiJiig may be quite high; but this high corielalion is consistent 
with a negligible or even /oro influence of lierodily (in the strict sense 
of thowoid). Pei haps tlie inohlenibarraRHiiig situation aiibcs when the 
coriclatioii winch nnglil be expected tlnough the exclusive mfluence 
of hcicthly, conicidcH with that which might be expected through the 
exclusive influence of environinent 

A great deal of iiitiinsic inteiest attaches to the iclativc magnitude 
of kin loseinbliuuses iii intelliKcnce, lieight, cepluihc index, eye color, 
etc, The point accins to deserve emphasis, however, that meiely 
biometuc ftUuUes of kin vesemblivucc (under uueonUollod conditions 
of environment), do not yet have the necoHsaiy psychological, genetic, 
and matlicinatical basis foi miything like rigorous, quantitative 
interpretation of resullH. ICxpeiimenial or pio-expeiimcnlnl studies 
of tlio typo of Biu’kw/^ Fieenian,-'^ Mullei,^ Newman/^ Gesell/ 
and TryoiP^ seem indicalecb 

NoTK — Dncussioii of tilo foipgoing piipoi with Uu Tryon has biouglib foiMi 
tl\o foUoVrinR poillW 

1 The use in eon elution attoiuling the pool mg of tests may not be spiuious, 
Ml llie sciiho that ihe use may ho iiiloipioted ui two ways (a) One possible cause 
of the rise may bo the olobor balanoinRj m Iho pool, of factors luieorrclatcd between 
the siblings (tins accouls with Spoammn's U^o-fJletor tlieoiy of mental abilities). 
Whothci eithoi Iho gcinoial fartoi oi the Hjioeifie faoLoifl aio hcicditary or 
Guvnonmcntal or both, is not divulged by Ibc conflation coefficiontB alone (t) 
All altoinative caufeO of the iisg may bo Lho fiilloi Ham phiig of abilities m 
pool than in any imliviciiml test (Ihia aoeoids ith a iiiulLijilc-fnctoi theory) 


nssuniptioiia concoiinng both the iiiodo of mlienUmce iiml Um system of mating 
In fcho case of luiman mental inhuutanco, ignoianeo of the mode of inhciitaiicc 
would nppeiw to pi Delude coiiruUmt uae of any one of Wngbl^s foiinul». 

* Inasmuch as a >5010 coclhcioiit icinaina unnUered by the collection for 
restricted range 



K%n Resemhlances 


381 


2 A difference between paicn't-cliild correlations lu two psychologically 
umtaiy traits may aigue as well for a diffeient mode of inheritance as for a differ- 
ential effect of enviionniont 

3, In the compaiison of coiielntion coefficients, due consideiation must be 
given to the natuie or make-up of the vainibles concerned It is woifcli noting 
that the effect of poolmg usually diminishes rapidly, ns the snse of the pool nicrenscs 
Tina suggests the dcaiinbility of compaimg eitliei simple elementaiy tiaits, m 
which the effect of pooling is absent; oi highly complex tiaits, in winch the effect 
of pooling 13 fanly stable, and peihaps iimforin 

References 

1 Fisher, R A The Con elation between Relatives on the Supposition of 

Monde] lan Inheiitance T)ansnchom Royal Society Edinburgh^ 10 18, Vol 
II, pp 399-433 (ace especially pp 400, 401, 420, 432) 

2 Gesoll, A , and Thompson, 11 , Learning and Growth m Identical Infant 

Twins Genetic Psychology Monogra'ph^ 1920, Ko 6 

3 Hull, C , “Aptitude Testing,’^ Chaps 0, 7 Woild Book Co , Yonkeia, N Y , 

1928 

4 Jones, II E A First Study of Parent-Ciuld Resemblance m Iiiteliigence 

The Tvoeniy^Bevenlh Yearhooh of the National Society for the Study of Educa^ 
lion, 1928, Vol I, p 72 
6 Ibid P 69. 

6 Kelley, T L “ Statistical Method “ P 204, foimula 154 The Macmillan 
Company, 1924 
7, Ibid Pp 196-197* 

7a Ibid P 226, foimiila 187 

8 Kelley, T L “Ciossioada m the Mind of Man ” Stnnfoid University Press, 

1928 

9 Midlei, H J Mental Ti nits and Heredity Jouvnol oj Heredif 2 ^, 1926, Vol 

XVI, pp 433-448 

10 Newman, H PI Mental and Physical Tinits of Identical Twms Reaied Apait 

Journal of Heredity, 1929, Vol XX, pp 49-04, 97-104, 153-166 

11 Rosenow, C The Analysis of Mental Functions Psychology Monographf 

1917, Vol XXIV, No 5 

12 Slocombc, C TiumauL Kelley Mcasiiies Mental Ti aits J om nal of Edited^ 

Uonal Psychology, 1928, Vol XTX, p 601 

13 Spearman, 0 The Pi oof and Measurement of Association between Two 

Things American Journal of Psychology f Vol XV, pp 72-101 

14 Speaiman, G “The Abilities ot Man ” The Macmillan Co*, N Y , 1927 

15 Staich, U Siinilaiiho'j of Biothcia and Sist CIS m Mental Traits Psychologi- 

cal Review, 1917, Vol XXIV, pp 235-238 

16 Teiman, L M Natuie and Niii tine Then Influence upon Intelligence and 

upon Achievement /ouraal of Educational Psychology, 1928, Vol XIX, 
p 367 

17 TlioiJidike, E L The Resemblance of Sibling's in Intelligence Tho Tiienty- 

sevenih YeatbooK o) the National Society for the Study of Education, 1928, 
Vol I, pp 41-53 



382 


The Journal of Jklucalional P^u^hologij 


IB, IhuU l\ 4L 

10, Tryoii, K G.* Tho Goiiotica of Loainiiig Ai)ility in Hats 0/ Catv 

JotmaVuhluQhonsinPBycholoiiyy 1920, Vol IV, pp 71-80 

20. WJloaglil>y, H* K.J Family SimilaritieB m Mentnl-fccgfc Abilities Tho 

Hmnlh Ycmhool oj ihe Nfxlxoml ^omiyfo) Ihe Hludy oj Eduealxon , 1928, Vol 
r,pp ri5-69. 

21. Wright, 3 r Syntems of ISIating, I Tlio lliornotric llclatioiiH botweon Parent 

and OJTapnng Gcridxc^^ 1921, Vol VI, pp 111-123 
22 Wriglit, S . SystcinB of Mating, V Gciioial Conaideratioiis G'enehes, 1921, 
Vol VI, p IfiO. 

23, In the Tweniy-mcnih YcQThQQh of th(^ HociQly Jot the Sludy of Educa- 

tiorij 1028, Vol h 



A NOTE ON METHODS OF MEASURING RELIABILITY 


T G FORAN 

Catholic Univctaity of Aiaeriea 

Three procedures are available for ineaguring the reliability of 
tests According to the first, the same form of the test is administered 
twice The second involves estimating the reliability of the entire test 
or scale from the correlation of its halves. In the third method two 
forms of the test, each given once, furnish the data from which the 
measuies of reliability aie calculated. The third procedure is genei- 
ally prefeired to the others All methods involve obvious diffcienccs 
under which the lehability of a test is found. 

The data in this study were compiled for the purposes of comparing 
the first and third methods as described above Pour schools weie 
used In one, the fiist list of the Morrison-McCall Spelling Seale 
was given twice to all pupils from the Grades II to VIII, inclneive. 
In the second school, the second list of the scale was used twice In 
the third school, the first and second lists weie used in that order 
In' the fourth, the second and fiist lists were used In all grades of the 
four schools, a day intervened between the firat and second tests. The 
lules for administering and scoring the tests stated in the scale weie 
followed precisely and all computations were performed twice on a 
calculating machine. 

Identifying information, means, standard deviations, and seveial 
measures of reliability arc piescnted in Table I. The averages of 
the reliability coefficients are highei when the same foim is lepeatccl 
than when duplicate forms are employed All reliability coefficients 
with one exception aie higher when cither List 1 oi List 2 is repeated 
than when the two lists are employed and comparisons aie made 
between the same grades in the four schools Nine of the twelve 
probable errors of scoie are lower for the single form method Further 
confirmation of these results is obtained fiom the probable eriors of 
estimated true scores 

In 01 del to render the reliability coefficient.s diiectly comparable 
through holding the variability constant, each coefficient has been 
used with Kelley's formula' 

a _ \/ 1 — R 
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with Z or lliG laigoi fllaiulard clovialioix aibitrarily set at 10 In 
nine of tho twelve possilJe coinparisoiiH of tlio Harnc giadcs m the 
four schools, higher cocfliciciitH arc bocurccl from the two applications 
of the same form In one of the three coinptuisonft m which the levcrse 
occuned, the difference is negligible. 

In Tiible II the ineasuies of ivhabdily have boon averaged, With 
throe grade-groups and two schools for each nudliod, six measures 
contnbiite to each of the averages The dilTorencc between the 
means of the coeflicients of lehabiliiy appears to bo considerably 
gicatei Limn between the iS’s, A bettor comparison is possible through 
the moasurea of improvement over chance, 
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Vl - r 
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Table II — Means qv Six Mbaberhs op REi,iAniLi'!!\ fob. Each Arrangement 

OF Tests 



Sninefoim 

1 twice 
(1-1, 2.2) 

Duplicate 

1 forms 
(1-2, 2-1) 

r 
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PEfloopo 

1 12 

1 49 

PEeai t B 

1 08 

1 39 

Total number of pupils 

416 

809 


The improvement ovei chance has been computed from the 
foimula ^ 

Ip = 100(1 - vr^^) 

While the moans of the leliabihty coefRcienls ovei-emphasiJio the 
difference between the methods, a substantial difference remains 
when variability is hold constant 

Tabic III contains the significance ratios for the combinations of 
reliability coefficients The significance ratio is the diffcience between 


Taule III — SiaNiriCANcE Ratios op DiFFEnENCiSB between IIdliadiliti 

COEPPlClETiTS 
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the coefflcients divided by the probable error of the difleiencc. The 
probable cirois of the difference have been found by means of the usual 
formula ^ _ 

PEijiff = + PE^r-2 

' IIolaiBgci, Kml J “Statistical Mc^ihods fo\ Students lu Education Ginn 
and Co , New Yoik, 1028, p 166 

® Gai'vett, Ileniy E “Statistics in Psychology and Education ” Longmans, 
Green and Co , Now York, 1926, p 171 
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The Hifiiuficiinco mtioa arc ponilivc when llio fivsL cocflicient of the 
pail IS higher than fcho .sccoiul, 'Hic moans of the ratios have been 
found without rcgaul to bho signs of the ratios It is noteworthy 
that tho order of the tests has no influence on the results when the 
tests iiip similar foiins Tlie most unporlnnl dilTeronces occur when a 
rohalnhty coefRcient obtained fiom (ho samo form used twice is com- 
piiicd with the lehabiliiy eoeflicienfc from aiinilar foims The signifi- 
cance ratios are much larger for Guides VII and VITI combined than 
for Grades V and VI together In general, reliability coefficients 
from repealed tests are significantly liighci than the same measures 
found horn one use of each form of the tost 
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DifTcicuro IS positive whon wcontl lest has Inglioi luoiiii Means aic not 
woightod 


Some measuie of practice effect under the same conditions is 
possible fiom the data at hand Table IV contains tlic differences 
between Uic means for all grades and schools. The practice effect 
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involved in taking the same test twice is considerable. It is greater 
for List 1 than for List 2, the means being 1 98 and 1.48 but tins may be 
a sampling error The algebraic mean of the differences between tlio 
two tests m the last six groups is + 19, There are some indications 
that List 2 18 more difficult than List 1, When the oi der of the tests is 
1-2, the mean gain is 44 but when the order m reveiscd the mean gam 
18.81 


CONGLUmONS 

1, When allowances aie made for differences m variability, 
reliability coefficients are higher for repetitions of the test than for 
siimlai forms. 

2 The order in which the tests are given has no effect on the results, 
even when one foim is slightly more difficult than the othei 

3. The practice effect of taking the same test twice is estimated 
to be 1 5 times the practice effect from duplicate forms This obtains 
only for the Mornson-McCall Spelling Scale 

4, In view of the results of this study, it is important to consider 
the conditions underlying the determination of tost leliability 

5 Using the method of two forms, the probable error of estimated 
true scores of the Morrison-McCall Spelling Scale (and probably 
for any well scaled spelling test of fifty woids) is 1 4 words. 



SAMPLING KJIROII OF TJ-ymAO DIFFERENCES 

C SPKAURIAN 
Ilnivciwity of l/oiidon 

In the now proviLlent uaago of Iho formula for the probable cnor 
or vai iance of tetrad clifTcronce.s, * there la apt to be scant account taken 
of Iho epecial aBsiimplionB upon which tins foimula is based. One 
of these, namely that the variables should have a normal frequency 
distribution, is only clanBCTOua when great acemacy is wanted.'^ But 
the other assumption can do much more haim; it is that the correla^ 
tions arc measured by the ordmaiy pioduct moment ooeffioients, 
so that the variance of the coofficictil 

« (1 rT/N. 

One case wlicie this latter assumption may bo far from justified is 
that of coofR clouts whicli have boon corieclcd foi ntlcntuation. And 
even worse is the case of coelRcionta derived from any of the customary 
four-fold tables. On the other liand, the coefTicionta cleiived from 
ranks (with the cUtfeioncea squaicd) would not seem to mtioduce any 
disturbance of appreciable siac. 

Of course, Iheio is nothing to pi event anyone from so modifying 
the formula foi tho tetrad sampling euor that it does become valid 
for any coolFicient required. All that has to be done is that in deriving 
tho formula the above quoted cr," should be replaced liy the variance 
which is appropriate to that coeflicient. Such variances can he found 
in any good textbook; for example, in those of Ilolzinger, Ganett, or 
Kelley 


1 See tho piosoiit wrilci's "Aljilitics of Man,” nppciitlix, pp \-\i (except that 
on p, V, N slioulcl bo replaced by JV^^) 

’ Sco tln.s JoniiNAT., Nov , 1930, Diiluiln'iH of Tctiatl Diffojenccs 
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NEW PUBLICATIONS IN EDUCATIONAL 
PSYCHOLOGY AND RELATED FIELDS OF 
EDUCATION 

CONDUCTED BY PILANGES M, FOSTER 


AbnoimalPsijcholoay, ItsConcepls andTheoHes,hyB. L Hollmgwortli 
New York The Ronald Press Company, 1930 Pp XI + 590. 

A very distinctive as well as significant eontubution to the field ol 
abnormal psychology is Dr H L Hollingworth’s latest book. Tins 
work represents a seiious effort to make the concepts and theories 
concerning mental abnormalities psychologically mtelligible It 
also lopresenis a determined effort to systematize these concepts and 
theories The system constiucted has a logical place in it for facta of 
consciousness along with behavioi but the evaluations and reinter- 
pretations of materials selected for presentation can hardly be said 
to be eharacteiized by catholicity. Most viewpoints aie evaluated 
but the psychoanalytic — ^labelled by Hollingworth, the psychoana- 
logical — ^is vigorously attacked. His own conceptual system is con- 
sistently applied. In this system the general pattern of mental 
activity, abnoimal as well as normal, is said to be characterized by the 
ledintegrative sequence “Partial stimuli now occurring function 
for former antecedents of greater complexity." Learning and sagacity 
are the two impoitant aspects of these processes “Without learning 
there could be no mental activity, without sagacity, mental activity 
becomes biologically and socially ineffective." Feeblemindedness is, 
accordingly “relative inaptitude for ledintegiative activity." “ Unsa- 
gacious redintegiated responses give the picture of the psychoneuroses 
On the postural level such symptoms give the somatic, physical picture 
of hysteria; on the autonomic level, they comprise the complaints oi 
the neurasthenic, on the symbolic level they show themselves in fixed 
ideas, obsessive thoughts, moibid picturea and ruminations, as in 
psychasthenia." Psychotherapy consists in teaching the patient to 
substitute a symbolic for a postural or an autonomic response. Lack 
of space prohibits a fuller consideration of the fundamental cou- 
ceptions in this system They aie the same concepts which the authoi 
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has previously used in icconsti noting tlio facts and principles in general 
psychology, And the reconstruction is practically as thoioughgoing. 

In the Preface the author dilTeicnliatc.s his own interest in mental 
abnoimnlity as a student of natural phenommia fiom thn “everyday" 
interests of educators or hygienists and the “technological" inteiesta 
of psychiatrists or clinical p.sychologisLs. This implies to him a 
dominant inteicst m concepts iivUior than clinical picUnes, ideas 
rather than eases, principles riitlicr than proceduics; in short, an 
interest in undei standing rather than preventing or relieving mental 
abnormality. Many cases are presented — inoie than in some of the 
books which emphasize clinical pictures. The book loally contains 
more piactical features than the foiegoing statements imply. The 
chief leason, of com sc, I.*! that in dealing with problems of human 
behavioi the point of demarcation between diagnosis and tieatment 
18 hardly perceptible — the goal fiom the beginning to end can be said 
to be fuller understanding. 

The order of presentation ns well as the oignnization of the matc- 
nals in each of the twenty-five chapters is appaicnlly the result of 
much conscious planning The outline is clear and the mnicli con- 
tinous. The book begins with a succinct chapter on the subject- 
matter and uses of abnormal psychology. Abnormal behavior is heic 
diffoicntiatcd from desirable behavior. “It may be comfoi table,” 
we are told, “to bo noimal, since this will moan that we arc not con- 
spicuous, but normality, m the scicnlific sense, is nothing on which to 
pride oneself ” 

Following the introductory chapter are six vciy coinpiehensivc 
chapters describing historical and contemporary viewpoints. The 
only one that can not bo passed by without comment is the one which 
purports to give a fair account of psychoanalysis. Theic is no deny- 
ing the validity of a good deal of the criticism Noi can one deny 
Hollingworth’s greater clarity. But one is tempted to add that at 
least some of the clarity is obtained by ignoring fundamental diffi- 
culties which confront psychologists who aie more concerned with 
people rather than coiicepta 

In the consideration of ponsonaliLy deviations the author first 
attacks the simplci and more mcasuinblo deviations, advances to the 
“DwellcTs of Neurotica" and thence to the p.sychotics and other moie 
complex deviations. Two chapters are given to the feebleminded, 
nine to the psychoncuroscs and one chaptei a piece to each of the 
following topics’ Stage-fright and dieam, stuttering and stammoungi 
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aphasia and abynibolia, epilepsy^ constifcutional psychopathic states, 
pcisonality types and functional psychoses; and mental disorder and 
the effect of duigs ' 

Objective studies of the neurotic and the feebleminded aie fully 
treated In the discussion of the neuroses more than the usual amount 
of attention is devoted to the contributions of Babbmski, Hurst and 
Rosanoff as well as those of Janet and Prince The psychoanalytic 
contributions of Fieud, Adler and Rivcis me pieseiitcd as Hcrbaitian 
conceptions of the neuroses, The icsult is inteiestmg reading but 
can hardly be considered as more than a forced interpretation, a 
waste-basket variety of calegoiizmg Holhngwoith^s explanation of 
primitive behavior m terms of ledintegrativc sequence is no more 
realistic than Fieud's winch lie cnticizes — neither is based on actual 
anthiopological studies No moio convincing is the description of all 
Freudian forgetting as “ undei learned material” 

A critical evaluation of fictional neuro-anatomy, a valid ciiticism 
of Cotton^s overvaluation of the r61e of infection in. mental disoiders, 
a much needed emphasis on the idle of the learning process in the 
development of the functional disoidcrs, a healthy emphasis on the 
how as well as the what of the thinking of the contributions con- 
sidered — these, in the opinion of the reviewer, are among the most 
pleasing as well as distinguishing featuies of the book 

H Meltzbr. 

Psychiatric Clinic, Samt Louis, Missouri. 


The Guidance of Mental Giowth in Infant and Child, by Arnold Gesell, 
New York. The Macmillan Company, 1930 Pp XI + 322 

If parents and educators more frequently combined their avowed 
love and respect for little children with the sympathetic point of view 
gained by scientific study of mental development, many child adjust- 
ment problems would bo solved. Dr Gesell shows a larc appieciation 
and respect for childhood’s complexities, and he beholds with wondei- 
inent the oidcrly progression of mental unfoldment which his own 
techniques, skillfully applied, have revealed He shatters many an 
illusion and yet builds up oui faith in the possibilities of solving behav- 
ior problems. If in his enthusiasm the authoi verges at times on the 
sentimental and stresses the obvious, these tendencies do not detract 
from the soundness of the principles discussed Theie is occasional 
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lepetilion due to incluaion of pioviously publiahecl ui tides which 
oveilap lo content. 

Childien have not alwny.s been .so syinpatheiically understood 
but tlio growing tendeney towaicl clearer conceptions of the purpose 
of cluklhood and pftront-child rclal lonslnps is revealed m the accounts 
of early nuiRory school pi oji'cts and in the coirc.spoiidonce of intelligent 
motheis of whom Susanna Wesley was an illustration Older con- 
cepts of child guidance aic illuslraled with iin amusing and charming 
series of old prints and lithographs The modem nursery school with 
its attendant piogiam of scientific child study is the newest addition 
to institutional cduciiliou and promises to integrate tho activities of 
homo and school of childien below kinderguiten age. Instead of the 
kindei'gaitcn giving fornrul inatructioii based on dubious psychological 
pi'inciiilcs, we find the modern kindcigarlcn assuming an important 
r&lo in child guidance, forming n continum witli the nursery school and 
the elemontavy grades. 

Concerning the mental development of the child ag determined hy 
tho ingenious nielhoda of the Yale Payclio-chnic, the author has many 
significant findings to ropoit Tho most impoitnnt piinciples formu- 
la,tcd are those concoimng the rapidity, complexity and ordorlineBS of 
mental growth, from birth to maturity. 

Dr Gescll formulates normality of mind in terms of. (1) Whole- 
some personal habits of living; (2) wholesome habits of feeling; and 
(3) healthy altitudo.s of action 

Concerning the pail played in development of the two factors of 
heredity and environment there has boon a gical deal of misunder- 
standing Dr. Gcsell’s treatment of tho topic is one of the sanest 
and most mtoresting of existing leporta He finds that the child 
IS remarkably well insulated against chance enviionmcntal influences 
and conditioning and that much of what in the young child appears to 
be the result of training and teaching is really the result of mental 
unfoldmciit and natmal maturation. Because the child is a human 
being certain boliavioii.stio trends aic bound to assort themselves in 
spite of oven decidedly adverse cnviioninontal conditions Physical 
handicaps do not drastically alter the behavior capacities of the 
child. The inovilablcness and surety of maturation safeguaids the 
child against advontitious circumstances 

The validity of the conclusions ropoitod is well cstablmhed and 
their application in child guidance work will be unqueslionnhly 
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beneficial Every one who has child training responsibilities will 
find Dr Gesell's book inteiosiing and valuable. 

Gertrude Hildreth 

The Lincoln School of Teaoheis College, Columbia University, 


The HiiviEW oe Educational Research 

The fiist issue of the first journal to attempt a systematic review 
of educational lescarch has just appealed The Review is the official 
organ of the American Educational Research Association which is now 
a Department of the National Education Association, 

The first issue deals with the curriculum It was prepared by a 
committee consisting of Dr, Homy Ilarap, Dr, William L Connor, and 
Dr Ralph W. Tyler, assisted by several other persons. This issue 
includes an extensive classified bibliography and tieats of methods 
of curriculum-making, studies of the objectives of the cumenlum, 
studios of loainmg which bear upon the curriculum, time allotment 
and giade placement, etc. Poui othei issues dealing with teacher 
persoimol, school oigamzatxon, special methods up to the end of the 
elementary school, and individual differences and psychological tests, 
are scheduled to appear during the year The whole field of reseaich 
has been divided into fifteen topics which will be covered m three years. 
Three numbers will appear during the spring and two during the fall. 
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OUR NEED OF SOME SCIENCE 
IN PLACE OF THE WORD “INTELLIGENCE” 

C SPEARMAN 

I Contributions of Pbofessob Dearborn 

Not long ago the presont wntci vcntuied to onkcizo a bbok by 
Professor Deaiboin on “Intelligence Tests He has now been good 
enough to lespond;* and on one point at any rate I hasten to acknowl- 
edge a misunderstanding I had complained that his book, whilst 
referring copiously to the small and contioversial part of a work of 
mine/ had nevertheless taken no notice of the laige and constructive 
part. In reply, ho now stales that his book, although published in 
1928 (June) consisted really of some old Icctuic notes written two years 
earhci , hence, ho says, its contents did not rcfei at all to the said work 
of mine published in 1927 (March), but instead to anothoi work written 
by me as far back as 1923.^ Although not without surpiise at his 
manner of making books, I must admit that it has here rendered my 
criticism inapplicable, and so, with apologies, I withdraw vt 

However Piofessor Dearborn, after thus making his own defence, 
passes over to a counter-attack I will quote his own words, in order 
to render justice, not only to his puiport, but also to his style He 
charges me with “a biazen, if belated, effoit to steal some of Binet’s 
thunder,” and supports this chaigc by alleging that “Binct did 
have some ideas of his own, pieciously like the common factor of 
Spearman ” 


‘ Houghton, MiHlin and Co 

“This Journal Octoboi, 1930 

“ “The Abilities of Man,” Macmillan, 1027 

^ "Nature of Intelligence and Principles of Cognition,” Macmillan, 1922 
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To begin with, I should like to congmtuliile him on liia choice of 
objective, Cei tain ciiticsof our ilicoiy of Two Factors make a pretence 
of attackmji; it fundamentally wlieii in truth they arc only dealing with 
unimportant details, what is really essential in our theory they tacitly 
appropiuite to thoinsclvcs (mostly under new names) . Not so 
Professor Dearborn. The point of attack ehoaon by him is both novel 
and vital Ho would appear to charge us with nothing less than 
plagiausm; the very hub on which our theory rolls, the gciicial factor 
itself, this he acci edits to our eailicst antagonist, Binet. 

Despite this tribute to his honesty at any rate, in another respect 
Professor Dearborn, to apeak fiankly, is disappointing Since he 
takes up a position of such giavo moment, one might expect to find 
him ontienchcd behind a great mass of specific and cogent evidence. 
Actually, ho brings foiward no evidence whatever. Although my 
own representation of Binot’s work had from end to end been accom- 
panied by citations of that writer^B voiy words, Prof. Dearborn m 
his turn does not add a single new quotation; noi does he even indicate 
any fresh way of interpreting those cited by me. Instead of any such 
thing, he gives us simply his personal conclusions, Such a procedure 
may be well enough in the class room, or even in electioneering hustings 
But on the aiena of science, just as in the couits of justice, I submit 
that it is too high-handed. We requiio the actual facts on which the 
asscifcions claim to bo founded, so that we may have an opportunity to 
examine such claim for ourselvca. 

II Dilemma of Binet 

Attempting to make good this default on his part, lot us first of 
all see what was the standpoint of Bmet before the appearance of 
General Intelligence,' objectively delormined and measured,”^ which 
was published by the present writer in Apiil 1904, and already con- 
tained all the essentials of the theory of Two Factors In particular, its 
main object — as shown m the very title — was to intioduce a “general 
intelligence" that admitted of measuicmont by tests. Before this 
publication, the standpoint of Bmet seems to have been most char- 
acteristically expressed as follows* 

Wo pioposo the study of the ton following proccfiscs Momoiy, the nature 
of mental images, iinngmatiou, nttention, tho faculty of undei stand mg, suggesti- 
bility, the aesthetic scntlmont, moral aoatimcnt, muaciilai foioe, niid force of will, 
motoi ability, and coup d’ooiL These aio, wo bcliovo, mental faculties that chffer 

^ American Journal of Psychology ^ Yol XV, 
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greatly from one individual to another, and aio such, that the knowledgo of their 
state with an individual gives ua a general idea of that individiiaU^ 

He then proceeds to supply us with several tests for each faculty 
Memory is to bo tested by goometiic designs, phrases, music, and 
colours. Mental images, by the nature of the errors of repioduction 
Imagination, by ink blots, composition of pictures, and combination 
of words into phrases Attention, by regularity of reaction-times, 
and by success in counting two mctionomes simultaneously Com- 
piehensions, by definitions, by peiception of resemblances and differ- 
ences of meaning, and by criticism of phrases,^ Of any ^'general 
factor he does not so far seem to have manifested any trace Indeed, 
even the term/ intelligence^* does not appear to be mentioned And 
to the best of my knowledge, he made no ladioal depaiture from this 
standpoint right up to our afoiesaid publication of the theoiy of Two 
Factors in 1904, 

But he ceitainly did so two years after that date, For then he 
and Simon brought forward their world-famous “Metric Scale of 
Intelligence “ They wiote. 

Our aim is in no way to study, to analyse and disengage the aptitudes of those 
who are mforior m mtolhgoficc That will be tho object of a latei work Heie, 
we will loatiict ourselves to appreciating and mGasuring their intelligence in 
general, wo will fix tlioir mtelleotual level; and to give an idea of that level, we will 
compare it with that of normal children of tho same ago, or of analogous level ^ 

But lioie, wo must undci stand one another on tho meaning of that word bo 
Vftguo and bo compiehonaive: "mtclligoncc Almost all tho phenomena with 
which psychology la concerned mo phenomena of mtolhgoncc, afionsation, a precep- 
tion, arc intellectual manifestations as much as m a leasomng Ought wo then to 
introduco into our examination tho measurement of sensation, as is done by 
payeho-physiciats? Ought wc to put mto our testa the whole of psychology ? 

A little icfleotion has shown ns that that would bo a gicat loss of time Thoie 
is within intelligence, so it seems to us, a fundamental organ, that whoso lack or 
porveision is of the greatest importanoo foi piactical life, This is judgment, 
otheiwisG called good sense, practical sense, initiative, the faculty of adnptmg 
onobQlf, To judge well, to imdei stand well, to reason well, these aio the essential 
springs of inbclhgonco ^ 

These words, at first reading, were delightful enough. For between 
this measurable “intelligence in gcneial“ thii^ newly advocated by 

* Ann&e Psychol , Vol II, published in 1896 Tho date on tho volume is 1896, 
but this, it appears, always icfcrs to the prmous yeai (aupposcly the time thafc the 
actual lesearch was effected) 

^ Ibidem 

^ Ann^ePsyclioU, Vol XI, published in 1906, sec above* 

* Ibidem, 
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Binct find the measurable ^'gencial intelligence^^ intioduced two 
years earlier by myself, theie seemed to be no difference. And as for 
his ''fundamental organ withm the mlelligence,” this appeared to bo 
only £L Bpeoial mterprctation of our factor There are accordingly 
some grounds for concurring with Prof Dearborn to the extent that 
h]) tlm lime (1906) Bine! did have the concept of a general factor in 
intelligence. 

Put of any such likeness between lus view and ours, Binet himself 
seems not to say a word, As I pushed on with the pei usal of his work, 
expecting every moment to come upon Ins expiession of cordial agree- 
ment, I encountered indeed a review of oui theory of Two Factois, but 
this only announced his disappioval 'of it, on the giouiid of it being 
“stuffed wilh mathematics^^ ’ 

The fact seems to be that, so far as theorizing is concerned, his 
adoption of our geneial factor was only half-hearted, Ho was toia 
in two opposite directions On the ono hand, he naturally endeavoured 
bring Ins utterances into harmony with his new metric scale. But 
on the other hand, he continually regieased back to the old faculty 
doctrine, for upon this had been built up, and now stood iirevocably 
founded, his whole general psychological outlook Even m this very 
metric scale that we have been discussing, ho flagrantly lapses into 
the facultism again; for he expressly assigns to each of his tests its 
own special faculty or facuUiesv Thus his test of cutting paper is said 
by him to be one of "voluntaxy attention, reasoning, and visual 
imagination ** His discnminatiou between objects is called a test of 
^^ideation, the notion of difference, and to some extent the apiiit of 
observation His repetition of digits is said to involve the faculties 
of “immediate memory and of voluntary attention " His test of 
pictures— to which he subsequently attributed such dominant impor- 
tance — IS here only taken as ^'destined to seek whether thcic exist 
associations between images and their names In the second version 
of the metric scale published three years later, all such indications 
of special faculties to be measured by the respective tests was, indeed, 
abandoned. But very soon afterwards, they weic re-introduced and 
more explicitly than ever. For now he goes so far as to write that: 

The mental faculties of each subject are independent and unequal Our 
mental teats are always apccifie m tlicir scope; each suits tho analysis of a single 
faculty d 


* Lea Id^ea modcines sui les Enfnnta, 1909 
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In these words, the general factoi or ^'fundamentiil oigan'' would 
seem to have quite faded out of the picture. 

But whilst thus in theoietical discussion ever regressing back to 
his ingrained facultism in the actual practice of ineasuimg the logic 
of facts diove him iricsislibly more and more along the new path of 
Two Factors Already in 1900, as manUoned, he had indicated his 
intention to measme the lever' of his '^intelhgenco in general" 
But how was such a feat possible? The word ^'general" means 
something common to all or nearly all of a class, as exemplified in 
the phrases a “general direction" or the “general government." 
But with the faculties, he himself stated (as we have ]iist seen) that 
no such common level exists His sole resource was to take “ genci nl" 
not m the sense of common, but m that of middle or average Such 
averaging, however, was just what we had advocated ahoady in 1904. 
Bjillmntly original, then, as was his proceduie m detail, in essence it 
was following ns 

III, Limitations to the Validity of Avetiaqing 

But was he here really entitled to follow us? The procedure of 
averaging, wide-spiead and invaluable as it is in both physical and 
mental science, has nevertheless its Imntationa It is only legitimate 
when ceitam postulates aio fulfilled One of these is the uncquivo- 
cality of the domain at issue You cannot, for instance, obtain the 
average height of an Ainoiican without first sctlling who is to count 
as one And then, having got the domain definitely settled, it is 
imperative to take the whole of this into the leckoniug. Thus, you 
cannot claim to have got the monthly average of your expenditure 
during any year if you leave out of calculation, say, Decembei A 
thud postulate is that your leckoning should present no overlaps, 
thus, it would not do to bung in December seveial times Still more 
fundamental is the need of comparable units. You may indeed 
equally well derive your average expenditure by taking every day, 
or every week, or every month. But you would not be lational if 
you mixed up days, weeks, and months indisciiminatcly together. 

Now, on the theory of faculties, one at least of these postulates 
appears impossiblo to satisfy, namely, that of finding any common 
unit by which the difTeicnt faculties can be bi ought into mutual 
connection Thus, how shall a common unit be found to make 
memory compaiable with judgment? We might take the whole of 
memory as one single unit whilst we divided up judgment into seveial 
kinds each constituting a unit of its own; or else equally well we might 
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take judgment aa keing one and subdivide the memory. The one 
basis for averaging would favor some individuals, and the other basis 
others Thus the score i cached by averaging becomes aibitrary, 
therefore invalid 

And the matter becomes much worse still, if we pass from the 
clear but untenable theoiy of faculties to the extremely vague theory 
of ^intelligence” commonly favoied. For here, all foui of the said 
postulates fail to be satisfied To find any common unit lemains 
as impossible as befoic. In addition, there seems no way of avoiding 
large omissions; for it would appeal hopeless to attempt to include in 
the tests every sort and description of ‘intelligence,” Furthermore, 
there appear to be no means of arranging that none of the tests overlap 
each othei, indeed, they often admittedly do so And lastly, no 
agreement seems to be feasible as to how the domain of this “intelli- 
gence” should be delimited, for gome authorities want to include one 
thing and others others, 

Nor would the preceding difficulties be in any degree escaped by 
shifting from the notion of average to that of a “totality ” Foi the 
latter also would involve every one of the aforesaid postulates (even — 
as might perhaps not be expected — ^that of a common unit). Nor 
yet would any relief be brought by substituting, as many later writers 
have done, the notion of a “sample.” For this too would involve 
the same four postulates — with other troubles superposed.^ To all 
this may be added that actually mental testers, far from having over- 
come these difficulties, have hitbeito not so much as made any serious 
attempt at doing so. 

But what is sauce for the goose, it may be urged, is also sauce for 
the gander. If all this averaging is so irrational when employed by 
the facultistg and the intelligentists, how can it pretend to be satis- 
factory in the hands of the two-factorists? The reply is that in the 
latter case all the preceding difficulties do surprisingly dissolve away. 
For in it, no claim is raised that the result of combining together 
different tests is to constitute any rational average, or central value, 
or totality, or sample The sole claim raised is that, in such a proce- 
dure, the gpeci&c factors tend to cancel out, leaving the general factoi 
alone dominant As was said originally: 

“The apecifio elcipont can to a great extent be readily eliminated by varying 
and combining the hinds of test,^^ whereby the gonoral factor or ‘*ccntial func- 
tions^ stands out in corresponding exactness ^ 

' ‘'The Abilities of Man,“ Chap. V 

^A7nencan JourmlP^ychologi/f Vol XV, April, 1004 
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Fortfws purpose of oaneelliiig out, omissions or overlappings — unless 
they are highly systematic — do not greatly interfere Nor does even 
the manner m which the units aie constituted. And as for the domain 
from which the tests are to be derived, this in the theory of two fiictois 
IS no longer equivocal. Its domain extends to just as many abilities 
as may be observed to satisfy the two-factor onteiion. 

IV. Plea pon an Awakening 

What IB the upshot of all this? Not unnaturally perhaps, Prof 
Dearborn comes to the conclusion that, in. apilo of all, the situation is 
well enough; that, even if the current procedure of measuring the 
“mental ages” and the “IQ’s” is indeed equipped with a wiong 
theory, it nevertheless admittedly is right in practice, which is what 
alone leally matters 

Now, it is just against this attitude of quietism that I would here 
desire to make a lively piotest For in the first place, even the prac- 
tice current in testing is only right with very crude appioximation. 
It only succeeds evci in yielding a definite measurement at all if and 
when the sub-tests entering into the whole team of them are sufliciently 
numerous and selected at random Now some sort of randomness does 
derive from the mere fact that those subtests are gathered together 
from highways and byways without any system oi plan But this 
facile mix-up is insufficient to secure that perfect randomness — in 
the sense of freedom from all bins — which statisticians mean by the term 
and which is needed to produce the dofimte “p ” In order to obtain 
such freedom from bias, the procedure should not be without all plan, 
but on the contiary planned with great care Whereas the present 
tcat-makeis, quiet light-heartedly allow themselves to be strongly 
biassed towards several objectives, such as ease of application, self- 
consistency, correlations with other things, and so foith. 

But theie is a still worse objection to the curient procedure Even, 
if this did happen to pioducc pure g (or any olhei definite measuic), 
nevertheless when divorced fioin the theoiy out of which it sprang 
it would pay the penalty of foifeiting all significance; the ineie average 
of sub-tests picked up and put together without rhyme or reason 
must needs present — at any rate until pi oof is given otheiwise — the 
very acme of meaninglessness. And as for the ciistomaiy dignify- 
ing of this galhraaufroy of tests by the title of “intolligencc” — without 
so much aa an attempt really to construct them in accordance with 
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uny explicit principle — this device comes unpleasantly near to psycho- 
logical chaioctenstics. 

Having regal d to these two defects, then, those of indefiniteness 
and of meaninglessness, there is but small wonder that the current 
procedure from time to tiino commits, even m piactice, blunders of 
great magnitude, so that ihero is only too good icason to suspect 
that many a child branded by test has theieby unjustly had hig 
career wi coked And tins terrible fallibility of the tests is only 
lendered the moie dangerous by the vast edifice of statistical data 
and calculations which me often osstentationsly piled upon them and 
which do but convert them into whited sepulchics 

But by what manner of means, it may be asked, is all this evil 
going to be made any the better by bringing on the scene the theory 
of Two Factois? Are not those also repeatedly charged with being 
entities of an obsouio, speculative, or hypothetical kind? To say 
this about the factors ia totally to misapprehend them, as we will 
now endeavour to show. These two factors, o and s, do not in them- 
selves signify any entities whatever; they aie nothing moie than parts 
of actually observed measurements of ability And these part-values 
have at least the virtue of peifeot quantitative definiteness, that is to 
say they are, when taken rightly, “unique ” But to acquire scientific 
meaning, a further step is required, there must be proof supplied that 
these part-values, besides being definite quantitatively in themselves, 
also serve as measures of some qualitatively definite psychological 
functions And this, too, we may claim, has actually been done, 
In particular, the g has been found to measure “noogenesis This 
term denotes tlie following thice actually and piecisely obseivable 
mental functions The first is the knowing of our own experience: 
we not only feel, but know that we feel, we not only strive, but know 
that we strive, we not only know, but know that we know, The 
second of the mental functions consists in that, when any two or 
inoro items are perceived or thought of, we may cognize relation 
between them, for example, we may become aware that one thing is 
like another, or is evidence for another, or is the cause of it An 
outstanding instance of this among tests is that of “synonyms and 
antonyms,” where two words arc given and the testee has to decide 
whether they are very alike or very unldce, Thiidly and lastly, when 

'The “noB-’' comes from the Qicck »o0s, and indiontes that processes of this 
form alone piodiioo knowledge The “-genesis” indicate that such processes 
ftlont! generate new oogrutivo content 
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we perceive or think of any item and also of any appropriate relation, 
we may evoke the idea of the item which stands to the given one in 
the given relation. A. well know instance among tests is that of 
^^opposites/^ where the testeo is gjven some word and is told to say 
what is the opposite to it These second and third functions are 
usually chavacteiised as ''cductivc ” 

Whilst thus urging that the noegenetic processes are conceived 
in a manner free from all indcfiniteness, we may take the opportunity 
to defend them from the charge sometimes raised that they are only 
of a “logical^^ nature, not of a psychological” one What is heie 
meant by logical haa been left by these critics regrettably obscure 
But possibly the notion is that these kinds of process have little or 
no importance foi undci standing, anticipating, and controlling the 
course of mental life. In reply, wo must claim just the contiary 
These three processes follow in general a settled sequence, and m 
such fashion that each piepares the way foi the following one. Thus, 
the awareness of one^s own experience supplies all the fundamental 
items of knowledge; next, bo tween these items (possibly in some 
cases simultaneously with them) Iho iclalions arc cognised, and finally 
the lelations thus furnished arc displaced to othci items and thus 
produce all correlative and novel items which are the mainstay of 
mental creation and invention, including that super-invention which 
is behavioi.^ To recognise this sequence of the three steps and to 
explore the conditions which facilitate each of them should constitute 
one of the mam objectives of all functional psychology, including in 
particular its applications to education, medicine, and industry. 
And all this is called ^'not psychological but logical” I 

More subtle and thciefoio still more dangeious than any such 
direct charges against the noegenetic analysis is the not uncommon 
practice of tacitly ranking it with ineie iinevidenced asseitions on the 
mattei For example, the vidav that mental tests involve no egenesis 
IS put on the same footing with the assertion that they involve 
adaptibihty or educability, and so forth Tins is done regardless of 
the fact that the noegenetic view is based on the most elaborate and 
exhaustive measurements in all detail, whereas the other views have 
nothing behind them but unsuppoi led statement 

But even tins establishment of g as being a measure of the ability 
called noegenesis is only the beginning, by no means the sum, of the 

^For a full but simple account of such displacement of lelations, icfeience 
nuistbemade to tlic piescnt wiiloi's "Cicfitivo Imagimition,” Appleton, 1930 
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definite and scientifically significant contributions of the theory of 
Two I'actoTS, In support of this claim, appeal may be made to the 
aecond part of '^Tbe Abilities of Man'" quoted on the first page of this 
paper. For this whole part is packed, not with anything obscuie or 
speculative, but with fiindaracnial facts actually observed by a muUi- 
tucle of mdefatigablo workers duiing the past quarter of a century 
And to all this light which the Two Faotois have shed upon the work- 
ing of the mind must be added that which they have thiown upon 
the ounent tests of the socallccl general intelligence For the g appears 
to constitute just that which is common to diffeicnt tests oi sets of 
tests, and thus to furnish the sole stable element in intelligence-test^ 
mg. To this stable element, the tests at present in use supply only 
crude approximations; what they contain over and above this g varies 
in an incalculable and theiefoio unscientific manner from one such teat 
to another 

Theie is yet another objection commonly raised to the theory 
of two facfcois Here, the claim is advanced that this mode of analys- 
ing the scores made in a tost is only permissive, not obligatoiy; other 
manners of analysis arc proposed — or moic often vaguely suggested as 
possible — to take its place. Against this attitude we must pload that, 
on the contrary, there are places foi any number of different analyses; 
any two different ones may quite well be both of them true and oven both 
of them valuablQ, or both of them the reverse. Kaeli has to stand or 
fall independently, its fate must be settled solely by the amount of 
scientific information which it produces For example, the definitely 
observed fact that g measures noegenesis lemams quite unaffected 
by what any other factors arising from any different analysis may or 
may not happen to measure. If any factors othei than g and 8 do 
also happen to render useful services^ then these services can only 
supplement one another, and thus enhance each other^s values 

All in all, then, the plea is here raised that the current procedure 
of testing ^intelligence" needs to be aroused from its self-complacent 
slumber. The present real basis of it is only a piactice that has been 
borrowed from another theory. And this practice fails to be satisfac- 
tory because, when the practice was borrowed, the thooiy itself was 
left behind. By so doing, a sacrifice was made of piecisioii; of mean- 
iugfulness, and above all, of an immense amount of observed funda- 
fental facta This disastrous situation has been largely masked, but 
at the same time really aggravated, by usurping the pretentious and 
wellnigh fraudulent title of "intelligence." 



an experimental study op the influence of 

MOTION PICTURE FILMS ON BEHAVIORS 

FRANK N FREEMAN 
Univeiaity of Chicago 

AND 

CAROLYN IIOEFEE 
Elizabeth MoCoiinick Memorial Fund 

Tlie purpose of this study was to determine whether motion picture 
films add to the effectiveness of instruction winch is designed to incite 
children to perform specific acts. The problem is one phase of the 
more general problem of the comparative effect of motion pictures and 
of other influences in guiding or modifying conduct. In this particular 
instance the instruction, of winch the motion pictures arc a part, was 
designed to influence conduct largely through giving clear-out informa- 
tion and pointing out the applications of this infoimation to conduct 
The motion plctuies which weie used should have been chiefly of 
an informational nature to harmonize with the character of the general 
unit of instruction Suitable informational films could not bo obtained, 
however, and the films which were used weio cast in story foim. 
They were designed to appeal to the emotions as well as to the 
intellect 

The instruction dealt with the care of the teeth. This subject was 
chosen because it was believed that any change in the children’s 
behavior aa a result of instruction could be more objectively measured 
in this field than in any other which was open to investigation The 
Elizabeth McCormick Memorial Fund, moieover, was in a position 
to provide systematic curriculum raatoiial on this subject and to make 
contacts with officials of the Health Department of Chicago and of the 
Public Schools ns a result of the eo-opeiative study of other problems in 
health education. 


* Tina study was made possible by a giant fiom the Committco for the Study 
of tlio Social Values of Motion Pictuios of tlio Payne Fund Giatefnl aclcnoivlcdg- 
mentia olso mado to Dr Gcoigo Wandol of Uio American Dental Apsocmtion end 
Dr. Lon Moiroy of the Iloallh Dopnitment of Chicago for the loan of the filnos and 
for iissistanco m the piopavation of dental lessons, to the Chicago Depaitiiient of 
Health and the Supeimtendent of Schools foi tlie assistance given in the dental 
examinations 
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The expenmenl waa mado in two public achoola of Chicago Two 
fifth and two sixth grades in one school were taught with the aid of the 
films, while two fifth and two sixth grades in another school in a 
comparable neighborhood weie tanght without the films In order 
that the instruction might bo comparable, except for the films, it was 
all given by the same person, Miss Mildred Dawson. Miss Dawson 
also served as general a.sbistnnt in the experiment. She is a very well- 
trained and competent teaclicr and supei visor. 

The instruction was given in thirteen periods, from May 8 to May 
22 inclusive, The following is the outline of topics* 


Lesson 1 — ICnow yoiii teeth. 

Shape and fimcbion of teefch 
Losflon 2 — StmcUuo of a tooth, 

Lesson 3 — Diet for teeth. 

Lesson 4 — Diet for teeth. 

Lesson 5 — Deciduous teeth. 

Lesson 0 — ^Permanent teeth. 

Lesson 7 — Six-yoar molara 
Lesson 8 — or story, 

Lc^ison Q — MaloccluBion and mastiGation. 
Lesson 10, — Causos of decay 
Lesson 11 — ^Picvention of decay, and review 
LesBon 12 — Caio of the tooth, and review 
Lesson 13 — ^Pilm or writing slogans 


Charts and diagrams wore used in the instruction of both groups 
to supplement oial instruction. The time occupied by showing the 
film to the experimental group was employed lu reading a stoiy and in 
conducting an exercise in writing slogans m the control group 

The two films which were shown to the experimental group are 
entitled Tommy luoker^s Tooth and Clara Cleans Her Teeth The 
fiist tells the story of a boy who was refused a job for which he applied 
because of hig unsightly teeth, but who later had his teeth looked 
after and was then accepted The second tells of a girl who enters a 
new school where the children have been trained to care for their 
teothj and who is ostracized because of the pooi condition of her teeth 
and her indiffeicnce to it. She, too, reforms and becomes socially 
acceptable to hei schoolmates. Some information is given in the 
films, but it IB subordinate to the stories 

The effectiveness of the insti action in the experimental and control 
groups was measured in four ways, namely: 
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1 An infoi'infttion test, given at the beginning and the end of the period of 
ins true tion# 

2 A qucationnaiiQ in wliicli the child icn icpoitcd on the cftie of their teeth 
nt home and the food which they ate, 

3 The mafceual bi ought in by the chilclicn, consisting of clippings of vaiious 
soils, oiiginal matewal written by the childicn, booklets mid, UtDratmo taken 
homo, and scoio cards winch the childicn filled out; 

4 Condition of tlic teeth ns detoimincd by a dental examination given nfc the 
beginnmg and at tho end of the expciimcnt 

Results The Infoemation Test 

The iafoimation test was given at the beginning and the end of the 
experiment to both groups It consists of thirty-six multiple-choice 
questions^ The questions relate to the structure and the development 
of the teeth, the causes of defective teeth, and the care of the teeth 
Throu|?h difficulty m tabulation, four of the questions weie omitted, 
leaving thirty-two The information test is not a direct measuie of 
behavior Since the purpose of much of the instruction, howcvci, 
was to give information, it is important to know whether tho films had 
any influence directly or indiiectly upon the amount of information 
which the childien obtained A comparison of the gains m information 
m the two groups is, therefore, presented 

Tlie differences in the average ability of the children in the individ- 
ual grades of the two schools was so gicat that it was thought neces- 
sary to make matched groups based on scoies on the intelligence tests 
and the initial scores on the intoiination test The matched groups 
were foimed, not by matching individuals, but by selecting individuals 
from the two groups so that there would be an appi oximately equal 
number in each class of the clislubution This foim of matching gives 
not only equal average scoies, but also an appi oximately equal number 
ab the various levels of ability 

Table I gives the data on the losults of tho information test fioin 
the equalized groups It will be obsei ved that the avGiage intelligence 
quotient and the average initial score of the two gioups are practically 
identical 

It IS apparent that both the boys and gii Is of the con brol group made 
sciTiGwhat higher average scores on the information test than did the 
childien of the experimental group, but the difference is hardly statisti- 
cally significant. We aie safe in saying, liowevei , that the films had no 
appieciable influence on the acquisition of information This is, 
perhaps, not surpiising, since the films were not designed piiixiniily to 
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give mformaUon. They weie designed rather to make the children 
interested in ca-nng for tlicii teeth All vve can say, then, is that these 
films I designed to awaken interest in the care of the teeth, did not stim- 
ulate the ohildien who saw them to acquire moie infotmation than the 
children who did not sec them. Intciest m acquiring information 
about the teeth is evidently somewhat mdopendent of interest in the 
care of the teeth, assuming that the films have stimulated interest in 
the oarc of the teeth. It is, of coutBC, possible that they did not stimu- 
late such interest The inference that the two types of interest are 
independent, therefore, la nob conclusive. It is Goiitingont upon au 


Tabltj I — ^The Scores op tub ISQUAtiizHD E\rBRiMENTAL. and Control Groups 
ON TUB Information Test a’t tub Beginning and tub End op tub 

Experiment 


Equalized groups* 

No 

Aver- 

age 

IQ 

SD 

Aver- 
age 
Teat I 

SD 

Aver- 

age 

Test II 

SD 

Expel imcnfcal school 








Boys , . ... 

mm 

100 98 

16 247 

14 el 


27 73 

5 992 

Girls 

53 


n 474 

16 40 


23 62 

4.180 

Boys and girls , . . 



13 617 

15 16' 


28 17 


Control school. 








Boys 







5 708 

Girls . , 


lor 37 


16 41 

3 623 


4 896 

Boys and girls 



14 236 

16 15 


29.36 

6 370 


^ Equalized on basis of sex, intelligence rating and initial score on information 
test 


assumption for which we have as yet no evidence. We shall have to 
hold the conclusion in abeyance, therefore^ until wc have examined the 
evidence concerning the effect of the films in stimulating interest in the 
care of the teeth 

In order to discover whether the film was of special aid in giving 
particular items of information, the individual questions of the infor- 
mation test, which bore upon the activities involved in the care of 
the teeth, were tabulated separately. In only two questions does the 
experimental group give any clear evidence of being superior to the 
control group in the gains on the individual questions The correct 
answer to the fiiat of these questions is: The motion of the brush should 
be up and down, and to the second : To keep the teeth in good conclitiou 
we should eat some food that requires much chewing The method of 












Expey'imenlal Study of the Influence 


415 


using tlie toothbrush was shown in both films, and the use of food which 
requiies chewing was shown in the film, Tommy Tuckers’ Tooth The 
superiority of the film group m these two questions, therefore, is 
plausibly explained by the fact that the items of information or of 
activity to which they lefer arc specifically emphasized m the film 

The Results of tub Questionnaiub 

At the end of the experiment, the children of both groups were given 
a score caid to fill out On this score card they were asked to report 
whether or not (1) they possessed a tooth-brush, (2) they brushed their 
teeth daily, (3) they used a dentifrice, (4) they ate vegetables daily, 
(6) they ate fruit daily, and (6) they drank milk daily. 

The results of the questionnaire are tabulated m Table II, The 
table shows the percentage of children of each group who answer the 


Table II —The Responses to the Questionnaire on the Garb op tub Teeth 
ON Ea-tino Given at the End of thb Experiment 



Homo onro 

Food 


No 

Poasoaeion 
of tooth' 
brush 

Teeth 

brushed 

dftOy 

Uft-Q of 
dontifnoo 

Vego- 

tables 

cnteti 

daily 

Fruit 

oaten 

dally 

MiJk 

drunk 

daily 



No 

Per 

Qont 

No. 

Por 

ooufc 

No, 

Por 

cent 

No. 

Por 
a eat 

No. 

Por 

cent 

No 

Per 

cent 

EipenmontM 6-ohool * 
Boya ; 

02 

02 

100 00 

00 

07 83 

88 

05 06 

85 

02 3D 

88 

05 06 

01 

08 01 

Girla 

100 

00 

00 00 

08 

08 00 

05 

06 00 

' 01 

04 00 

01 

01 00 

06 

05 00 

Boys and girla 

Control Bohool . ^ 

102 

101 

00 18 

168 

07 02 

183 

06 31 

170 

03 23 

170 

03 23 

180 

00 SB 

Boya 

80 

80 

00.03 

00 

74 10 

88 

03 20 

81 

01 01 

87 

97 76 

89 

100 00 

Girls 

81 

80 

03,77 

72 

88 SQ 

77 

06 00 

74 

01 30 

78 

00 80 

77 

06 00 

Boys and girla 

170 

100 

07 06 

188 

81 18 

100 

0-t 12 

155, 

01 18 

165 

07 08 

ICO, 

07 06 


> Beaorde of ton boya and aix girla inoomploto duo to abeonao 
^RcoOrda of eight boys and four girJs inoomploto duo to abaonco 


various questions in the afflrmati vo. It is obvious that, if the childi en's 
testimony is to be lelied upon, a large peroentago of both groups per- 
form. faithfully the act which they were taught to perform in. the 
mstruction Whether or not they would have given an equally good 
account of themselves at the beginning of the expeiimont we do not 
know. On account of the high scores in both groups and the uucei- 
tainty concerning the accuracy of the childien^s replies, small diffei- 
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enecs between the two groups arc of no significance. The only item on 
which the diffcience may bo significant is that concerning the daily 
brushing of teeth. Ninety-eight per cent of the children of the experi- 
mental group reported that they brushed their teeth daily wheieas 
only eight y-ono per cent of the contiol group made a aimilai report, 
Since tiro films emphasize the daily brushing of teeth very strongly, 
this difference may be significant The films also emphasize the 
other itonia, however, and it is not altogether cloai why there should 
be so much more difference in this item than in the others. So far as 
it goes, the data suggest that when a particular action is strongly 
emphasized in a film the emphasis may be effective However, it is 
not at all eloai why the control group should have fallen so much lower 
in blushing their teeth daily than m using dentifiico, or in eating the 
various kinds of f oo d which were advised Taken altogether, then, the 
results of the questionnaire d.o not itidicatc much one way or the other 
concerning the iclativo influence of the motion picture and of oral 
instruction. 


MEASuaEs OP Interest 

As measures of intcicst a record was kept of certain specific 
voluntary activities on the part of the children This record included, 
first, a record of all the clippings or original articles, pictures, poems, 
stories, etc., which were contributed by the children, second, the 
number of booklets which weie read by the children of their own 
aocoid, the amount of literature which was taken home and the 
number of acoro cards concerning their reading which they voluntarily 
kept. The booklets, literature, and score cards weie placed on the 
desk where the children could get them and they weie told that they 
were free to use them if they wished to do so. 

A summaiy tabulation of the contributions and voluntary acts is 
found in Table III. A comparison of the integral numbers in the table 
IS qualified somewhat by the difference in the total number of pupils 
in the two gioups. The number rcpiesented in the experimeiitnl 
group IS 268 and in the contiol group 182. Some of the chffciences, 
however, are of such magnitude that this qualification is of minor 
importance 

It will bo seen that the pupils of the expeiimental group brought 
in a much larger number of articles and pictures and contubuted a 
largci number of original articles, cartoons, and pictmes The pupils 
of the control group brought in a somewhat larger number of poems 
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nnd drew a somewhat larger number of posters The differences, 
however, aie not so laige as those in favoi of the experimental group. 
Taken as a whole, it is clear that the pupils of the experimental gioup 


Tabui in. — A Eecobd op Ckiitain Voluntaby Activities CAnniBD on, Used 
AS A Mbasuhb or Intjuiibst 



Expeiimental echool 
(102 boys, 106 
girls, 208 total) 
No. 

Control school 
(07 boys, 85 girls, 
182 total) 

No 

Contnbutiona 

Clippings. 

53 


Arbiole 

7 

Cartoon 

3 

6 

Chart 

7 

1 

Maga^Ane 

1 

3 

Model 

0 

1 

Pamphlet 

2 

0 

Picture 

410 

72 

Poem 

2 

20 

Poster 

0 

4 

Story 

2 

1 

Total 

480 

123 

Average per child 

2 31 

0 68 

Original 



Article 

16 

3 

Cartoon 

26 

4 

Chart 

1 

4 

Picture 

40 

9 

Poem 

10 

4 

Poster 

0 

14 

Story 

7 

1 

Total 

99 

39 

Average per ohUd 

0 48 

0 21 

Grand Total 

579 

162 

Average per child 

2 78 

0 80 

Average booklets read 

0 69 

0 66 

Average pieces of literature taken home 

0 74 

0 82 

Average scona cards filled out 

0 40 

0 3B 


contributed a much laigor nuixibei of ai tides and of original matcimls 
of various sorts as leckoned in terms of the avcitige number of contiibu- 
tions per child In the number of booklets read, the literature taken 
home, and the score cards filled out, howevci, there is no significant 
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difteionce between the two gioups* The balance is slightly in favor 
of the experimental gioup and the influence of the film appears to be 
somewhat significant It is probably significant that the item m 
which the expeiimeiltal group is most superior is in the number of 
pictures which were contributed. The sight of the motion picture 
apparently suggested to the childien that they find similar pictures 
and bung them to the class The lesults do not suggest a great differ- 
ence in general interest or motivation between the two gioups. 

Change in the Condition op the Teeth 

It was thought that a change in the condition of the teeth might 
be a moie objective measure of the care which was exercised by the 
children or their parents and might, theiefore, be the most objective 
measure of the effectiveness of instruction The two types of changes 
which seem to be most significant are the change in the number of 
carious teeth and the change m the number of teeth which have 
received dental care The lepoxls of the dental examinations at the 
beginning and the end of the period of instruction were therefoie 
examined to obtain a comparative measuie of these two typos of 
changes in the experimental and the control groups. 

It IS necessary to confine the comparison to the permanent teeth 
There is a difference in practice among dentists in the treatment of 
deciduous teeth — some fill them, others do not. 

Again, some deciduous teeth disappear between the first and second 
examination and the number of carious teeth would, therefore, be 
deci eased without any effort on the part of the child or his parents. 

The first permanent molars, sometimes referred to as six-year 
molars, were selected for examination because these are the permanent 
teeth which have been in the mouth the longest time They, theref oi e, 
give the greatest opportunity for decay and for the exercise of dental 
care. 

In interpreting the condition of the teeth or the change m the condi- 
tion of the teeth it is necessary to take careful account of age The 
eruption of these molars themselves is highly correlated with age 
and the eiuption of tho neighboring teeth, which have an influence 
upon decay, is also correlated with age For this reason it was neces- 
sary to equalize the groups m accordance with the diatribution of 
ages, in the same manner as was done for intelligence and initial scoie 
in the tabulation of the results of the infoimation test Since the 
teeth of girls eiupt eaihei on the aveiage than those of boys, it is 
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necessary also to keep the results from the two sexes separate in the 
tabulation 

The first tabulation of a cliange in the condition of the teeth 
i 5 given in Table IV, This table shows the incictise or dcoioase in 
the number of carious teeth from the first to the second examination. 
The groups have been equalized with respect to chronological age, 
but obviously they have not been equalized with respect to the condi- 
tion of the teeth at tlic hist examination In the experimental group 
there were 263 carious molars at tlic first examination whereas in the 
control group there were 318 This may indicate greater suscep- 


Table IV —Chan an in tub Numbbu op CAnioua First Pbiwianent Molars 

FROM THE FiR&T TO THE SECOND EXAMINATION AFTER TUB G ROUPS HAVE 

Bern Eoualurd for Age 



No. 

Avernge 

CA 

m out] 18 

First examination 

, Second 

1 cxainniation 

No. 

carious 

moJars 

Avciago 

poi 

child 

No 1 
canons 
molftra j 

Avernge 

per 

child 

Experimonta.1 school. | 







Boya. 

80 

138 37 

122 

1 42 

137 

1 69 


81 1 

136 04 1 

121 

1 49 

120 1 

1 66 

Boys and girls | 

107 

137 04 1 

243 

1 4G 

203 ' 

1 67 

Control school 







Boys 

80 

137 70 

108 

1 96 

107 

1 94 

Girls , . . , 

81 

135 60 

IBO 1 

1.86 I 

138 

1 04 

Boys and girls 

107 

130 08 

318 

1 00 

300 

1 80 


tibility of the cliildien of the control group to caues or it may 
indicate that these children have had less care The average number 
of cauoua molars per child mereased in the expcilmental group 
and decreased m the contiol group. At first sight this may 
appear to indicate that the mslructioii was moic efficient in the control 
group than in the experimental group. Account must be taken, 
however, of the difference in the condition of the teeth of the two 
groups at the beginning of the experiment It is at least possible 
that the greatei increase in the carious teeth of the childien in the 
experimental school is due to the fact that there was greater oppor- 
tunity for increase 
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In order to furnish a check on thia possibility, the gioups were 
equalized not only with respect to chronological age, but also with 
respect to the condition of the first permanent molars at the first 
examination In other words, the children weie selected in the two 
groups so as to provide an equal number of carious molars at first 
examination The oompaiison is shown in Tnble V The difference 


Tabl^ V — Change in Tnn Ntjmdtjii op Cahious ?’msT Phhmanent Moii^ns 
FnaM THU Fnife^ TO THE Second Examination ai-tou the Geotjpb Have 
Been Equalised pou Initial Condition op These Molahb 





First examination 

Second examination 


No. 

Average 

OA 

No of first 
pel manent 
molars 

1 canons 

1 

No 

c&iious 

per 

child 

No of fiiafc 
permanent 
molais 
callous 

No 

cai 10U3 

per 

child 

Experimental school 
Boys 

47 

139 02 

92 

1 90 

79 

1 68 

Girls 

45 

133,20 

95 

2 11 

86 

1 91 

Boys and girls 

92 

136 17 

187 

•2 03 

166^ 

1 79 

Control school 







Boys 

47 

138 94 

91 

1 94 

85 

1 81 

Gills 

46 

133,82 

96 

5 U 

86 

1 01 

Boys and girls 

92 

136 43 

180 

■2 02 

17H 

1 87 


* Twenty-two molars carious at first examination and in “perfect condition'^ 
At second examination, 

2 Fifteen molars carious at first examination and in “perfect condition “ at 
second cxammation 

m the two gioups is now reversed The number of carious teeth per 
child decreases m both groups and slightly muie for the experimental 
than for the control group Apparently the unfavorable showing 
of the experimental group in comparison to the contiol in the earlier 
table was due to a difference in the initial condition of the teeth 
The difference in favor of the experimental group in the equalized 
groups IS hardly great enough to have statistical significance, particu- 
larly as it IS all due to a difference in the case of the boys It may be 
that we should expect no difference. Even the best of caie could 
probably affect but little change m the period of the experiment and 
the difference due to a difference in the effectiveness of the instruction 
m the two groups might be so minute as to be imperceptible when 



Table VI — Nitubeb of First PFitMANEi-rr Molabs Wbics Were iit ‘‘Perfect CoNi>moN 
Exajjination and Which Webe Cabious Filled ok EJxthacted at the &bcokd Exj 
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In order to furnish a check ou thisi possibility, the gioups ^ere 
equalized not only with respect to chronological age, but also with 
respect to the condition of the first permanent molars at the first 
examination. In other words, tho children were selected in the two 
groups so as to provide an equal number of carioua molars at first 
examination. The comparison is shown in Table V. The diffeience 


Table V— 'Ghai^QE tub Numbeh op Cahious First Permanent Molars 

FROM THE First to the Second Examination afidr tub Groups Have 
Been Equalized for Initial Condition op Thebe Molars 



No 

Average 

CA 

Fust oxamiiiation 

Second exammatiOR 

No. of fii&t 
peimancnt 
molars 
carious 

No 

canon a 

per 

child 

1 No oi hist 
permanent 
molais 
callous 

No 

caiioiiQ 

per 

1 child 

Experimental sobool. 







Boys 

47 ■ 


92 

1 tio 

79 

1 68 

Girls 

46 

133 20 

96 

2 11 

86 

1 91 

Boya and girls . 

92 


187 

2 03 

166^ 

1 79 

Control scliooU 







Boys 

47 



1 94 

86 

1 81 

Girls . 

46 

133 82 

96 

2 11 

86 

1 91 

Bays nnd girls , . 

92 

136 43 

186 

2 02 

171® 

1 87 


^ Twenty-two molars caiiouB at firet examination and m ^‘perfect condition” 
at second examination. 

Fifteen mol are canons at first examination and in '^porfeot condition” at 
second examination 

in the two groups is now reveised. The number of carious teeth per 
child deci eases in both gioups and slightly more for the experimental 
than for the conliol group Apparently the unfavorable showing 
of the experimental group in compaiison to the control m the eaihei 
table was due to a difference m the initial condition of the teeth 
The difference in favor of the oxpeninental group in the equalized 
gioups IS hardly great enough to have statistical significance, particu- 
larly as it is all due to a diffeienee in the case of the boys It may be 
that we should expect no difference Even the best of care could 
probably affect but little change m the period of the experiment and 
the difiercnce due to a diffeienee in the effectiveness of the msti notion 
in the two groups might be so minute as to be imperceptible when 
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mesiaured by Ibc rather slow process of dental decay. Substantial 
equality of the two groups in this respect, tliciefore, is perhaps just 
what should be expected. 

A more delicate measure of the effect of instruction is the amount 
of dental cate which was given the teeth which needed such care This 
was measuied by recording the number of teoth which were m perfect 
condition at the begtnmng of the expemment and became carious diumg 
the experiment These teeth evidently presented now problems in 
dental care. To determine how effectively these problems were met, 
a record was fuither kept of the numbei of sucli teeth which were filled 


TabijB VII — SoMMABV OP NuMnDB OP FinsT PraifMANBnr Molars Bbjcomino 

CAniODS DOBINO THB ExPSRtMENTAI/ PEftlOB WlIICII Wuniil GlVBN DbntAL 

Caiu: 



Summary of fifst 
permanent molars 

Second oxamination 


Not carious 
first 

, exairimation 

! 

1 


Plllod 

Ex- 

tracted 

Received 

dental 

care 

No 

Per 
cent j 

No 

Per 

cent 

No 

1 

Pei 

cent 

No. 

Per 

cent 

Experimental school | 










Boya . . 

96 

21 

22 1 

3 

3 2 

2 

2 1 

: 6 

19 2 

Girls . 

80 

16 

18 8 

0 

7 6 

3 

3 8 

9 

37.6 

Boys and gulsi 

176 

36 

20 6 

9 

6 1 

6 

2 9 ■ 

14 

28 0 

Control sohool 










Boys. . . . 

73 

21 

28 8 

2 

2 7 

2 

2 7 

4 

16.0 

Gills 

63 

17 

27 0 

6 

7 9 

0 

0 0 

6 

22 7 

Boys and gala , , 

136 

38 

27 0 

7 

6 1 

2 

i 5 

9 

19 2 


or extracted during the period of the experiment This record is 
tabulated for each of the four six-year molars scpaxately This 
tabulation is presented in Table YI. The individuals are selected fiom 
the groups which were equalized by age and approximately by average 
IQ, It may be lead as follows: Among the oighty-six boys who made 
up the equalized group in the experimental group there wei'0 twenty- 
seven perfect teeth on the first examination On the second examina- 
tion it was found that there were six carious teeth, one filled and one 
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extracted. In other words, eight teeth had become canons and of 
these two had leceived dental care. Twenty-five per cent of the teeth 
which had become carioiKs, therefore, had leceived dental care The 
significant figuies, therefore, are the percentages undei the column, 
Received Dental Care. 

The mam facta of Table VI are summarised m Table VII It 
appeals, for example, that among the boys of the experimental gioup 
there were ninety-five six-yoar molars which were not carious at the 
first examination Of these, twenty-six became carious, and twenty- 
one of these twenty-six remained carious at the second examination 
Thiee had been filled and two had been extracted. Of the teeth which 
had become carious, theiefoie, 19 2 pci cent had received dental care 
Among the boys m the control group, twenty-five teeth had become 
canons, and of these, four had received dental care, or 16 per cent. 
In the case of the girls of the experimental gioup, 37.5 per cent of the 
teeth which became carious leceivcd dental caie and of the giils in 
the control gioup 22.7 per cent of the teeth which had become caucus 
leceived dental caio. Tlio per cent for boys aud giils together in the 
case of the expeiimental group is 28 and the control group 19 2. 
While the numbers arc small, tho evidence points in the direction of the 
conclusion that tho children of the experimental group received bettor 
dental caie than did those of tho control group. In neither group, 
however, can the instruction be regarded as having been very effective, 
since fewer than 30 per cent of the teeth which required dental caie 
received it. 


Summary 

Tlie experiment was cairied on m two fifth and two sixth grades of 
two public schools. Gioup 1 which saw the films was in one school and 
Group 2 which did not see the films was in the second school. Tlio 
purpose was to measure the effect of seeing the motion pictures on the 
children’s behavior. 

The procedure consisted in giving the same instruction for thirteen 
school days to tho parallel gioups The teaching was done by a 
trained assistant. Tho subject-matter included instruction on tho 
structuie and development of tho teeth, on diet, and the care of tho 
teeth. Tho same detailed outline was followed with both gioups 
With Gioup 1 oral instruction was supplemented by pictures, diagi ams, 
and models, and also by two motion pictiue films entitled, Tommy 
Tucker's Tooth and Clara Cleans Her Teeth With Gioup 2 tho 
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motion pictuie film was not used. The number of children in Gioup l 
waa 208 and m Group 2, 182. 

The results of the instruction were measured by 

1 All information test 

2 A qncstioniiaiio m which the childion rcpoitcd on the caro of their teeth 
at home aiul the food wluch they ato 

3 M^iteisal bi ought in by tlio childien 

4. Condition of tho teeth ua determined by dental OKami nation 

1, InfoimaUon Test , — The groups were first equalized on the basis 
of intelligence test scores Group 1 advanced fiom a score of 17.03 
points to 29 47 points while Gioup 2 advanced fiom 14 85 points to 
29 69 points. Gioup 1 thus advanced 12.44 points and Group 2^ 
14.84 points or 2.4 points more The film gioup thus gamed less on the 
information test than the control group. 

2 Quesiicnnatj^e , — The childien of both groups leported almost 
universal use of the toothbiush and eaimg of vegetables, fiuit, and 
milk. Fewer children of Group 2 reported using the toothbrush daily 
(eighty-one per cent as compared with ninety-eight per cent). The 
difference seems hardly significant 

3. Material Brought In and Read — Group 2 read about the same 
number of booklets and took home more literature, but Group 1 
brought in many more clippings and contributed more oiiginal articles, 
cartoons, and pictmes. This comparison is somewhat m favor of the 
film group 

4 Remits of Denial Examinahon , — Since age is a factor in tho 
development and decay of the teeth, the groups wore equalized by 
ages After such equalization the comparison ^vas made of the 
average number of carious six-year-old molars of the two groups on 
examinations made before and after instruction In Group 1 the 
average number pei child increased from 1,46 to 1.57 and in Group 2 
the average number decreased from 1 90 to 1 80 The difference may 
have been due to a difference in the number of carious teeth on the 
first examination The groups were then equalized on the basis of 
the condition of their six-year-old molars on the first examination 
In Group 1 after equalization the average number per child of caiious 
six-year-old molars decreased from 2,03 to 1 79, and in Gioup 2 the 
average number decreased from 2 02 to 1 87 This shows a slight 
advantage foi the film gioup 

A comparison was then made of the molars which were in perfect 
condition on the first examination A smaller number of perfect 
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molars became carious in the cnee of Group 1 than in the case of Group 
2, (20 6 per cent against 27.9 per cent) A laiger number of these 
teeth received dental care in Gioup 1 than m Group 2, (28.0 pei cent 
against 19 2 per cent) This comparison is slightly in favoi of Group 1 
The children who did not sec the film apparently gained more 
information fiom the mstiuction than those that did The childicn 
who saw the film, however, appeal to have been stimulated to some- 
what gieatcr activity m bunging in supplcmcnlaiy mateiial After 
careful analysis has been made of the data, the group which saw the 
film appears to have improved somewhat more in the condition of 
their teeth than the pupils who did not see the film The difference, 
however, is not conclusive A slightly largei percentage of the group 
whicli saw the film received dental care, but fewei than 70 per cent 
of the defects of either group were corrected. Further expeiimenta- 
tion would be desirable with somewhat more carefully controlled 
conditions and with films which may bo more effective than those 
which were used in the expeiimeiit 



INTELLIGENCE, MOTIVATION, AND ACHIEVEMENT 

AUSTIN H. TURNEY 
University of ICfliisas 

Leading authorities in the field of psychology and of educational 
psychology recognize the existence of fundamental motivating mecha- 
nisms. Thus Gates writes of certain "cravings" and "urges" > and 
Woodworth of "dependable motives."* These fundamental motives 
are factors in school achievement to n giealcr oi lesser degree, depend- 
ing in pait upon the method of teaching being used Thus we have 
many writers accepting the project method as psychologically sound 
because it enhsta certain of these dependable motives * The literature 
of method is full of discussions concerning "motivation" or “motivating 
the pupil." 

The beginnmg student m educational psychology sometimes fails to 
appreciate the direct and practical connection between fundamental 
motives and actual schoolroom work. It has boon our expeiience that 
the importance of motivating mechamsme is made inoie clear if the 
treatment of this topic is linked up with the discrepancy between 
intelligence and achievement. This approach not only emphasizes 
the Importance of the t6le of motivation, but also recognizes the fact 
that one great educational problem is that of determining the extent 
to which motivating mechanisms affect achievement, and of detei min- 
ing the possibility of affecting these mechanisms through teaching 
teclmiquB and choice of content, 

A number of investigators have submitted data indicating that 
the discrepancy between intelligence test lesults and achievement usu- 
ally found in schoolroom situations is not necessarily the result of 
faulty measures either of intelligence or of achievement On the con- 
trary, this discrepancy is the natural result of other factors, chief 
among which are certain traits or types of behavior which foi want of 


* Gates, A I “Psychology for Students of Education.” The Macmillan 
Company, 1930, Chap VI 

* Woodwoith, U S “ Psychology.'’ Iloniy HoH and Co , 1020, Chap VI 
’Joidan, A M “Ediicational^Psychology ’’ Henry Holt and Co , 1029, p 113, 

Kilpatuck, W, H, "Poundationa of Method," The Macmillan Company, 
1926. 

Douglnss, n R "Modem Methods of High School Teaching " Houghton 
Mifflin, 1928, Chap iXI. 
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better terms we may call “industry, ” ‘'persistence," “arnbrtion," 
"school attitude," and “dependability."* 

This paper will present data BUggcsting that the behavior of 
pupils characterized by such terms as “industry," "porscverancc, " 
"dependability,” and “ambition,” as judged by teachers is probably an 
index of condrtions of motivation, and indicating also the importance 
of the factors of motivation in school achievement. The data wore 
secured in a study carried out in the Umvoislty of Minnesota High 
School Eveiy student in each of the four classes in the High School 
was rated by each of hia teachers twice during the school yeai on each of 
nine traits Tiro reliability of the judgments, as found by coi relating 
first and second judgments made about sixty days apart, was, on the 
average, .80 

Inter correlations were calculated for the following variables ® 

1 Numericnl value of all marks earned by each student during his entire 
residence in the high school 

2 Chronological ago 

3 IQ derived Xiom five oi moio tests 

4 Mental ago 

6 Industry 

6. Peiscveiance 

7 Dependability 

8. Ambition 

Foi the Junior and Senior classcfi pailial correlations of the first 
ordei weie calculated holding constant in turn CA, MA, IQ, and marks. 

Table I presents zero ordei coirelntions concerning the Junior 
class, Attention is especially called to the following groups of coeffi- 
cients showing the correlations between certain variables: 


Marks and MA 

57 

MA and industry 

33 

Marks and IQ . 

61 

MA and perscveinnce, . , 

36 

Marks and indiistiy 

80 

MA and dependability 

37 

M;arks and pcrscvoi once 

1 80 

M A and ambition , , 

40 

Marks and dependability 

82 

Industiy and pciseveiancc 

96 

Marks and ambition 

84 

Industiy and dependability , , 

96 

IQ and industiy 

37 

Industry and ambition 

93 

IQ and peisoverancG 

48 

Poisevcianco and dependability 

95 

IQ and dependability 

.40 

Pcisovoranco and ambition 

91 

IQ and ambition 

44 

Dependability and ambition ' 

93 


^See Tuiiicy, ^A, III, “Facioia Other than InLelhgencc That Aftecb Success 
m tho High School as Indicated by TGaohois' Marks ” Minneapolis, Minn., 
ilniveisity of Minnesota Pi ess, 1930, pp, 31ff foi a roviw of these studies 
^ The original data involve six other vaiiables omitted as not pei tmeiit to this 
Analysis. 
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Table I.— iNTERCOHttEI/ATIONS BETWEEN VARIABLES INDICATED 

{N = 06 Juniors, University of Mmnosoln High School, 1926-1027) 



1 

2 


4 

5 

6 

7 

8 


Marks 

CA. 

IQ 

MA. 

In- 

dus- 

try 

Poi- 

fievei- 

aiicG 

De- 

pend- 

ability 

Ambi- 

tion 

1, Mniks 

2 CA. . . 

IQ 

4 MA 

5 Industry 

6 Perseyeranco 

7 Dopenclfibility 

S, Ambition 


- 314 


o69 
- 410 
.952 



8^ 
- 118 
397 
368 
956 
950 

m 

- 358 

m 

398 

928 

913 

934 


Table II presents similar data concerning the Senior class in which 


attention is invited to the following coi relations: 


Mtiiks and MA, 

67 MA and industiy 

35 

Marks and IQ 

, ,69 MA and porseverance 

31 

Marks and industry 

05 MA and dcpoiidabiUty 

41 

Marks and peisoveranco 

63 MA and ambition 

89 

Marks and depend ability 

* 72 Industry and pereeveranco 

.90 

Marks and ambition 

68 Industry and dependability , 

90 

IQ and industry 

33 Industiy and ambition 

78 

IQ and pcrgevorance 

, . 32 Poi&evoi anoe and dependability 

91 

IQ and dependability 

41 Peracveraiice and ambition 

83 

IQ and ambition 

,, .40 Dependability and ambition 

82 


Table II — ^iNTBncoRnBLATioNs between Variables Indicated 
(iV = 48 Seniois, Univeisity of Minnesota High School, 1926-1927) 



1 

2 

3 

4 

5 

6 

7 

8 






In- 

Pei- 

De- 

Am- 

bition 


Marks 

CA 

IQ 

MA 

dUB- 

, sever- 

pend- 





try 

anoo 

ability 

1 Marks , 


~ aisj 


671 

661 

630 

717 

876 

2 CA 



- 736 

--1712 

- 265 

- 202 

- 266 

- 390 

3 IQ. 




.986 

330 

315 

407 

390 

4 MA . 





348 

305 

406 

389 

5 Industry 

6 Perseverance 

8. Dependability 

7 Ambition 

* 

• 

- 



660' 

896 

911 

780 

834 

816 
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For our purposes we may sumraaiize tho two tables as showing a 
correlation between marks and IQ slightly higher than the average 
coefiB-oient of correlation between measures of intelhgence and measures 
of achievement reported in the literatiiic.‘ Between marks and the 
traits of "industry, ” “pcraeveiance, ” “dependability" and "ambition, " 
the correlations are as high and, more often than not, higher than the 
correlation between IQ and marks or that between MA and marks 
The correlation between IQ and each of these four traits and between. 
MA and each of these four traits is relatively low, but the correlation 
between each pair of these four traits is high 


Table III — iNTEncomiBi^ATioNS between Vauiablbs Indicated wltit CA 

Constant 

[N = G6 Juniors, Univeisity of Mmnesotn, High School, 1920-1927) 



1 

Marks 

2 

IQ 

3 

MA 

4 

In- 

dus- 

try 

6 

Per- 

sever- 

ance 

6 

De- 

pend- 

ability 

7 

Am- 

bition 

1. Marks 


646 


780 


831 

823 

2. IQ 




3li 

308 

392 

330 

3. MA 




272 

258 

364 

293 

4 Industry 






958 

936 

6 Perseverance 






908 

906 

6 DopcncI ability 







903 

7 Ambition 









The relatively low con elation between each of the traits and 
either IQ oi MA suggests that neither are these ^intellectual” traits 
nor are the judgments the effect of halo Halo effect of marks upon 
judgments of the traits can scarcely be present since each of the judges 
furnished only one-twelfth of the Junior maiks and only one-sixteenth 
of the Senior marks. 

In Tables III and IV are the partial coefficients of correlation 
between the variables with CA constant. Of the coirelationa espe- 
cially pointed out above the gieatest change is in the case of that 
between IQ and marks which la somewhat reduced In the mam, the 
correlations between IQ and marks, IQ and the four traits, marks and 
the four traits, and between the traits themselves are not greatly 
affected when CA is held constant. 


^ Turney, A. II Op cxi , Table I 
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Tables V and VI present the paitml coefficients of correlations 
between each of the variables with IQ constant. It is to be noted that 
the conelations between marks and each of the four traits, ^^industry/^ 


Table 1 V — iNTBRComtELATiONs between VAitTADLEa Indioatdd with CA 

Constant 

(jV « 48 Semora, University of Minnesota High School, 1^26^1027) 



1 

Marks 

2 

IQ 

3 

MA 

4 

In- 

dus- 

try 

6 

For- 

sever- 

ance 

6 

De- 

pend- 

ability 

7 

Am- 

bition 

1. Marks 

■ 

.721 

870 

036 

610 


633 

2, IQ 


•< « 

977 

219 

252 

327 

181 

3 MA 




636 



033 

4 Industry 


, 

, 

, 



766 

6 TersovGranoo 



» , 




837 

6. Dopendability . 


4 




. . 

803 

7, Ambition 

■ 








^'perseverance/' '^dependability" and "ambition," and also those 
between the traits themselves are but slightly changed. 


Table V — iNTEUGouRBLATiONa between Vauiaules Indicated with IQ 

Constant 

{N ^ 06 Juniois, UinvGiflity of Mimicsota High School, 1926-1927) 



1 

Maiks 

2 

CA 

3 

MA 

4 

In- 

dus- 

try 

5 

Per- 

sevei - 

ance 

6 

De- 

pend- 

ability 

7 

Am- 

bition 

1 Marks .... 


- 020 

-.283 

783 

728 

800 

803 

2. CA . . . . ... 1 


. 

184 

026 

- 092 

098 

- 17C 

3 MA 1 


1 ^ i 1 

» > » 

- 072 ! 

- 387 

- 035 

- 089 

4 Industiy,,, 





D64 

950 

937 

6 Persevemnee 






944 

888 

6 Dependability .... . , 



• 1 1 




921 

7 Ambition , , . 

















The results of holding constant MA are shown m Tables VII and 
VIII The correlations between marks and the traits, and between 
the four traits themselves me but slightly changed 










Intelligence, Mohvahon, and Achievement 


431 


"When tnarka are held constant, as shown in Tables IX and X, the 
correlations between the four traits, “industry,” “perseverance," 


Table VI.'^lNTBUCORnBLATioi^s between Vahiableh Indicated with IQ 

Constant 

{N ^ 48 Seniois, Univcisity of Minnesota High School, 1026-1927) 



1 

Maiks 

2 

OA 

3 

MA 

4 

In- 

dua- 

tiy 

6 

Pei- 

sever- 

anoo 

e 

De- 

pend- 

ability 

7 

Am- 

bition. 

1 Mftiks 


398 


634 



,602 

2 CA 



147 




- 1B0 

3 MA . . 

, 



173 



031 

4 Industry 

1 


, 


.953 

884 

,749 

5 Persovcianco . .| 



, 



906 

816 

6, Dependability 

. . ^ 

, 

• 



, 

757 

7 Ambition 


1 







^^dependability^' and ''ambition, ” and both MA and IQ become very 
low and usually negative. The correlations between the traits them- 
selves are still high 


Table VII —iNTEBCORTinLATiONS between Variables Indicated with MA 

Constant 

(iV - 65 Jvmiois, University of Minnesota High School, 1026-1927) 



1 

' 2 

3 

4 

6 

1 6 

7 





In- 

1 Per- 

1 De- 

Am- 

bition 


Alarks 

CA 

IQ 

dua- 

tiy 

sever- 

ance 

1 pend- 
I ability 

1. Marks , . . , 


- 097 

267 

700 

777 

803 

818 

2 CA 



- 333, 

- 076 

- 188 

043 


3 IQ, , . 


, , 

1 

187 

BOO 

203 

227 

4. hidwatry , 





966 

053 

922 

6 Perseverance . 




1 


043 


(J, Dependability 

7 Ambition, 

- 


• 

' , 


• , 



The foregoing data indicato that the four traits, "industry, ” "per- 
severauGe, ” "dependability^^ and "ambition” are more closely related to 
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achievement than is cilhci IQ or MA, anti that they are not closely 
related to either IQ or MA, but that they are so closely related to each 


Table VIII — iMTBnaoBBELATJONB between Vahiables Indicated with MA 

Constant 

(AT = 48 Seniors, XJniv'crsity of Minnesota High School, 1926-1027) 



1 

Maiks 

, 2 

CA 

3 

IQ 

4 

In- 

dus- 

try 

6 

Per- 

sever- 

ance 

C 

Do- 

pend- 

nbility 

7 

Am- 

bition 

1 Marks * 


623 


614 


667 

G05 

2. GA 


, 

--.343 

- Oil 


036 

- 174 

3 IQ 





104 

002 

116 

4. Industry 





064 

883 

761 

5 PerseveranGG 






908 

821 

6 Dependability 







786 

7. Ambition 









other as to show marked overlapping ^ In view of the high reliability 
found for all of these data we can only conclude that the teachers were 
in fact actually judginE accurately the behavior of their students in a 


Table IX — iNTEucomELATiONS bbtwebn Vathableb Indicated with Marks 

Constant 

(N - 66 Juniors, University of Minnesota High School, 1026-1927) 



1 

2 

3 

4 

6 

6 

7 





In- 

Per- 

Dc- 

Am- 

bition 


CA 

IQ 

MA 

dus- 

sever- 

pend- 




try 

ance 

ability 

1. GA 


- 401 


088 

- 098 

267 

- 182 

2. IQ 



931 

- 262 

- 008 

_ 227 

^ 168 

3 MA 




.200 

- 207 

- 213 

- 181 

4 Industry i 





908 

877 

784 

6. Persevernneo 

6 Dependability 

7, Ambition 


■ * 

- ’ 



860 

739 

778 


specific sohoolioom situation where these traits represent the extent to 
which the students were motivated to confoini to classroom reqiiue- 


^ Garrett, H E “Statistics in Psychology and Education Longmana, Green 
&Co 1926, p 291 
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meats and to achieve m classroom activities. Hence these judgments 
represent largely the effects of motivation and they necessaiily oveilap 
as already shown. This overlapping of the traits and the lack of 
correlation between these Uavts and cithei IQ, MA, or CA point to the 
conclusion that the motivation existing m this situation was in reality 
the effect of “drive” or “dependable motives” as affected by the 
situation. 

The signiffcaneo and implication of those data are, we believe, 
rather great They should aeive to focus attention upon the leal 
nature of the disciepanoy between “iiitclligoiicc” and school achieve- 

Tablb X — iNTEncoumsuATioNs ncTWEEN Variables Indicated with Waiiks 

Constant 


(y = 48 Scniois, Umvcisity of Miiiiicsotii High School, 1920-1927) 



1 

CjV 

3 

IQ 

3 

MA 

4 

lu- 

cUi&- 

tiy 

5 

Per^ 

SGVGl- 

ance 

G 

De- 

peiid- 

abihty 

7 

Am- 

bition 

1 CA 


- 02G 

- 712 


- 007 

- 059 

- 255 

2 IQ 



972 

223 

- 211 

- 175 

- 120 

3 MA . 1 




- 172 

- 204 

- 148 

- 118 

4 Industry 





943 

808 

600 

5. Peiscveiaiico 






851 

710 

Q Dependability , 


. 





650 

7 Ambition . ► ► . 









ment. It seems clear that the two majoi factors in school achievement 
are intelhgenco on the one hand and “motivation” on the other. But 
motivation is not to be regarded as the pioduot entirely of the immedi- 
ate situation. The presence of fundamental diiving meehaniams, the 
play of interests developed long befoie, and the varying effect of the 
immediate situation in the schoolroom aie piobably all a part of what 
we call “motivation. ” 

Our data serve only to emphasize the presence and impoitance of 
factors of motivation. It would be dosiiable to know to what extent 
these factors aie the result of specific environmental situations such as 
the classioom. To what extent can the “dependable” motives be 
influenced by specific schoolroom situations such as the use of the 
project method or the socialized loeitation? In other words to what 
extent can the industiy and ambition of pupils be changed through 
educational influences? The vaiiability in responsiveness to specific 
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&limulalmg situations in the classroom inity be an much a Inologically 
fixed quality as ''inlGlligGiicc” is usually consulevcd to On the 

other hand, li may bo vastly more subject to educational (t e , environ^ 
mental) influences 

If wc accept for pin poses of discussion the concept of p ns set forth 
by Spoiviman^ the situation can be prcsonti'd in tlic following way 
Two students possessing equal ainoimis of q would not necessarily 
utilize it equally in the same classroom activity Moreover, even 
objectively measured, achievemont mufit involve a great deid more than 
p. Not all classioom activities would coriolate highly with measures 
of g,^ Many of thorn would depend as much or moic upon just these 
characteiistics of the student which we label *hiulustry,*' or “per- 
severance” foi success* Heiico the correlations shown between 
“industry, “perseverance,” “clcp(3nclabjlity” and “ambition,” and 
marks, arc piobably incasuies of a true relationship To the extent 
that the classroom work involves activiUcR not largely dependent upon 
a pupil^s p, or to the extent llmt activities very largely involving g are 
not attended to in equal proportion by sLudonls approximately equally 
equipped, a teacher^B marks could not con elate pcifectly with measures 
of intelligence, 

These facts might well be borne in rnind m using mental tests, 
They do not minimize the utility of tesla of "intelligence” but rather 
enhance their value. In ability giouping, for example, until the possi- 
bilities of motivation aie known, wo must agico with Billctt, * who is one 
of the few to point out the advisability of grouping on measures of men- 
tal ability alone. To include in the ciiieria for giouping measuies of 
past achievement coveis up the very important cffccta of motivation 
The possibilities of educational guidance, and the undoi standing of 
difficulties arc much greater with the use of the single criteiion If 
criteria such ns achievement tests which measure, m part, the effects of 
motivation are used, they should be utilized m a manner peimitting tlie 
teacher’s knowledge of their presence and weight. 

^ I nm not luiawnrc of tho argnmpols agaiiial Uj)« roncopt, as ni Uio Twenty- 
RGVGiith Yearbook of the National fiiocioty foi the Htudy of Education, Fait I, 
but acG Jennnigft, II S *‘Tho Biological Bafns of Ihimaa Nature New Yoik’ 
W- W Noiton, 1930, p, 24 

^Sprannaa, C. "The Abilities of Man ” The Macmillan Co , 1027. 

Ibid., Chap. XU. 

^ Billctt, II 0 A Controlled Expouiiicnt to Doterjinno tJio Advantages of 
IIomogGneous Giouping Ohio State University, Educalional Research B'nUeHn^ 
Yol VII; Nos, 7, 8 and 9, April 4, IS, May 2, 1928 



THE “OMISSION” AS A SPECIFIC DETERMINER IN 
THE TRUE-FALSE EXAMINATION 


C, G WEIDEMANN 


Teaclicis College, Univciaity of Nebraska 

Do students tend to omit items of the trae-falae examination that 
aie true moie of fcen than they tend to omit items that me false? In 
this study each item is either true oi false by published authoiity 
as the Giiterion 

The specific deierimner^ is a word or phase which occurs in the 
external form of a test item and alters the internal conshtuHom of 
that test item so that the correct response is either more often true than 
false 01 more often false than true. The specific deter tninei in any given 
test item may be so controlled by the individual who constructs the 
true-false examination that the coriect response is approximately eithei 
as often true as false or as often false as true 

Wood^ differentiates between inieinal constitution and the external 
form of examination items He says. 


The essential charaotei of a question, and consequently its ^‘statistical behav- 
101 ” dopencls upon its content as well ns its external form The content of a ques- 
tion IS often veiy subtle; many of the simplest^' questions aic found on inapection 
to be compounds of many subtleties. It seems quite Teasonable to suppose that 
within the limits of accepted forms of questions, the ^'mner'^ nature of a question 
is moie important tlian its outer” form; although as n matter of common sense, 
one may say that the ”outei'^ aspect exerts moie influence ns wo go down the 
intellectual or educational ladder and leas as we ascend it 


Assume that the specific determiners of a true-false exammatiou 
have been controlled, yet the variable of the tempeiament of the exam- 
inees IS still present, The temperament of examinees may cause some 
to respond more often true than /a/sc and other to respond more often 
false than true to the same teat item in a given tiue-false examination 
This variable of tempeiament of the examinee seems to be somewhat a 
specific determiner in relation to any given test item A study of this 
point needs to be made 


^ Wcidomann, C G . *TIow to Constiuct the Truc^false Examination Bui- 
eau of Fubhcations, Teach eis College, Columbia University, 1926, p 68 

^Wood, Bon D Studies in Achievement Tests Jouinal of Educational 
Psychologyp Vol XVII, Jaimaiy, February, 1920, pp 1-22, 126-139 
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So fai as an indivicUml cxnminoe is concerned, no direct technique 
seems to lie available to conliol the teinpci ament of that examinee 
while responding to the ilenis m true-false exaniinatioua whose 
specific dclei niiuers so far tin citenial foim mu concerned, liave been 
controlled on the nssiimplion that scoie equals right viimis wiony. 
In the case of huge gioups of oviniuipos tompoiamont might bo con- 
sidered to bo a chance factoi, compcnsatiivg in such a way that the 
tendency for some exaininoca to u'spond more often hue than fake 
would be ohset by the tendency of otheis to respond more often /a/se 
than true. This study nssumos the factor of teinpei ament of the 
examinees to bo a chance factor. 

Fiitz*- and a fow others have claimed that students tend to lespond 
to true-false items more times as hue than ns false The figiucs arc 
Bixty-two per cent true and thirty-eight per cent false, with technical 
information quite unknown to tho Htudents lie reiioits practically 
the same result with information which was studied by the students 
ns a icgulai part of the class work. 

Ruch’* reports “a niimbci of studies similar to that of Fritz" 
and gives fifty-two per cent maikod as true and foity-ciglit per cent 
marked as false. In an unpublished study by B. D. Buuoll, and 
0. L Cushman, (data nvnilnblo thioiigh G. M. lluch. University of 
California) "the results indicate that puio guessing, when it occurs, is 
roughly a 60:60 situation,” 

Rutledge^ found "that when the ‘same' items were stated in bolh 
true and false forms, they woro equally dlfliciilt ” 

These three studies make no mention of the “omission” as a specific 
dotei miner 

In the fall of 1926 m a course entitled "Foundations of Modern 
Education,” the writer used seven tme-false examination tests based 
upon P. P Graves’s, “A Student’s Hisloiy of Education ” At the 
beginning of tho semcstci, the class totalled three hundied thirty-eight 
divided into throe sections of ninty-ninc, one hundied three, and one 
hundred thirty-six students respectively. A total of three hundied 


‘Fritz, M F GiioHBiiig in a 'J’riu'-falBC' Test,. Joxiiml of Educational Psy- 
ehology, "Vol XVIII, 1027, pii. 

’ llueli, G. M “The Ol)]eelivo or Nnw-lypn Uvainiiialioii " Scott, Foiciman 
and Company, Now Yoik, 1020, jip, SOS 

’Rutledge, E IS "The Tiuc-falso ICxauiination in Elemontniy Phyclioiogy, 
with Suggestions for Its Iinpiovcincnt ” TJnpiiblishcd Ph.D Tliesia, University 
of California, 1027 
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thiity-one students included in this study lemained throughout the 
semester. The members in each section were given a reading assign- 
ment fiom Graves and within two weeks were given a true-false test 
based upon the reading assignment The object was primarily to 
measure immediate retention rather than delayed retention. No 
tost contained any items which aimed to review material covered in 
any previously given test 

In oidei to reduce cheating to a minimum each of the seven 
bi-weekly tests was administered in eithei Forms A, B and C or 
Forms A and B. The students seated in Columns 1,2,3 had Forms A, 
B and C lespectively; Columns 4, 5 and 6 had Forms A, B and C respec- 
tively, and so on After the foims weie answered they wore collected 
by the instuictor Then Columns 1, 2 and 3 had Foims B, C, and A 
respectively, Columns 4, 5 and 6 had Foims B, C and A respectively, 
and so on. Aftei the second order of Foims weie answeied they weie 
collected by the instiuctor. Then Columns 1, 2, and 3 had Forms C, 
A and B respectively, and Columns 4, 6, 6 had Foims C, A, and B 
respectively, and so on A similar procedure was followed when the 
bi-weekly test consisted of Foims A and B. The total test time of each 
bi-wcekly test was fiom twenty-five to forty minutes 

The fiequency with which each item of each Form of a given 
bi-weekly test was omitted was tabulated for each student taking 
each test All results are lepoited upon the basis that the number 
of true items equals the number of false items in each of the seven 
bi-weekly tests The specific detei miners of “all and never,” “moie 
than, less than,” etc, and “If . then” vveie controlled on the 
assumption that the scoie equals lights minus wiongs 

The directions commanded the student to mark with a plus (4-) 
only those statements which were cntiiely b ue, if the statement were 
partly or cntiiely false it was marked with a zero (0). A response 
space was provided to the left of each statement The students were 
told not to guess 

Table I displays the nurabei of times each omitted item was either 
hue or false A grand total of 3064 studenls lesponded to a giand 
total of 495 tiuc-falsc siaiements, accumulating a giand total of 3964 
omissions, in seven bi-weekly tests admimstoicd during one semester 
Table I shows that forty-four pei cent of the omitted statements 
weie true and fifty-six pei cent of the omitted statements wGia false 
Is the twelve per cent diffcierj'’e significant? The critical latio value 
IS aixteon, so that the diffeience is significant 
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TABL'D I — Ndmbbu of Tjmkb OmiUcd Items Ann Eitiibu True on False i-ou 
Each op thd Seven- Thue-palbe Tehtb 


Bi-wcekly 

tnia-falao 

The mun))Pi of times test items woio 
omitted Ijy tlic fitiidciit, winch items woie 

Total omissions 

test mimljer 

Turn 

False 


1 


3 

4 

1 

737 

005 

1392 

2 

270 

283 

553 

3 

159 

400 

559 

4 

219 

203 

422 

C 

57 

40 

103 

6 

112 

229 

341 

7 

172 

1 

412 

584 

Totals 

1720 ! 

2228 

i 3054 

Per cent 

1 44 

j 50 

1 100 


25ven though the statistical per cent diflcicnce is significant, tlieie 
IS relatively little val-uo m the per cent cliftciciice so far as affecting 
the scoie and placement of an individual student is oonecinod 

AsBumo: 

1 The Bcoic equal to the total nuinhci of items minus Uio omissions mimiB two 

times the 'sviongs, , 5 ^ 2' — 0 — 21K* 

2 TJiat on the average not iiioie than twenty items out of oveiy oup-liuiulicd 

items of a tuic-falbc o\amination would be onuttod by a given student 
Some may omit moie and othcia less itcinsi 

3 That every item so omitted would tlien be mailcccl false 

Then upon the basis of this study, fifty-six out of every one hundred 
omitted items arbitraiily mailted false would be nght and foity-four 
would be wrong. #S = 56 — 44 = 12 But, it is assumed that on the 
average, not more than twenty items out of every one hundied items of 
a truG-falae examination would be omiiled and arbitrarily inaiked 
fal^e, Thus the contribution of the omzmon 12 X 20 per cent or 
2.4 points of score. This change of score seems administratively to be 
relatively insignificant in the degree to which it may affect the place- 
ment of fui individual m a group 

1. Thrko hundred thii ty-one students who took the seven bi-weekly 
true-false te^s based upon Graves^ '’A Students Hisioiy of Educa- 
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tlon, ” m Cl udc per cents omitted items that were fahe more often that 
they omitted items that wcio iruc. 

2. The ormssion m the seven bi-wcekly truc-fal&e evaminations of 
this study is a statistically significant specific determine) . 'rhe ci itical 
ratio value is 10 

3. It seems to the writer that ii\ a very carefully constructed true- 
false examination “omissions" aie pioliably as often i)ue as fahe, 
and as often fdse as ii no 

4» From the standpoint of affecting the gmde placement of an 
individual student in a group, this study would tend to indicate that 
the omission as a specific dcteriuiner is not significant 

5 Furtlicr study will piobably show the of the truc-falso 

examination to bo statistically insignificant. 



FACTORS INVOLVED IN CIin.DREN’S FRIENDSHIPS! 

GLADYS GAllDNEll JENKINS 
Ilnivriflity of Cliiflngo 

The following study wns made in tlio effort to discover definite 
factoia winch influence llic foiining of fiioiulships among cliiJdrcn. 
There are, of course, ninny fnctois of n peiHoiml natiuc not yet possible 
of analysis, but there are others sucli ns the lelalivo intelligence of 
child and fiicnd, age differences, play inlorests, and like factors which 
are mensurable in some dcgiee and may bear upon tiio question 
The study included two hundred eighty boys and giils representing a 
cross section of the junior high schools of Riverside, California, a 
city of appioxiinatcly 35,000 inliabilants. 

ClinONOLOGICAL ACIK 

The chronological ago of one hundiod lughty clnlclren was compared 
with that of their friends. The range for ono hundred twenty-five 
girls was twelve ycais and five months to sixLecn years and eleven 
months; for thou* friends twelve years to nineteen yeais and eight 
months. For fifty-fivo boys the age range was twelve years and three 
months to sixteen years and four montlis; for their fiiends twelve 
years and five months to seventeen yoais The mean chionological 
ago for the children was fourteen yeans and three months and for their 
frionds fourteen years and five months, with a standard deviation 
of 10.6 months foi the children, and 13 0 months for their friends. 

Of tho one hundred eighty boj^ and girlssludiod uinoty-sevon made 
thoir friendships in school, eighty-tlirec outside of achool. The mean 
chronological ago for those friendships made in school was fourteen 
years and four months for both tho children and their fi lends, with a 
standard deviation of 10.3 months for the ehildion and eleven months 
for their friends. The mean chronological age for the eighty-three 
friendships made outside of school was foiu teen yeais and two months 
for the children and foiulecn yeais and six months for then friends, 
with a standard deviation of 10.9 months for the childicn and 16 1 
months for their fi’iends. As tlicrc is a larger spread in the chronologi- 

‘Tlio writer wishes to cxpioss hci indcbU'dnMs to the RUidanco of Dr Fmnk 
N. Freeman >ii this study, and to forinor Siipciintendcnt A N Wlicdocit ami 
Principal F P Taylor of the Hivorsido School System for their coopomtion in 
making available tlioii icoords 
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cal age range for those fi lends which fire made outside of school 
than foi those made within the school, it would seem as if the school 
has a tendency to dimmish the age diffeience in cliildren^s fiieudships. 
In spite of the larger standaiU deviation for the friendships made 
outside of school there is no uniform or pciccpliblo tonilcncy for chil- 
dren to choose friends either older or youngei than themselves The 
data aic presented in Table I. 


Table I — Compaiubon op Chiionolocjicaij Aon Biffkuonce between Cttild 
AND FuIEND with THE PLACE WlIEHE TllBY MeT 



The Pcaisoii pioducL-momoiit correlation coefTicicnt was +.470 
± .039 The coriolation coellicient for the niiicty-scven fnendships 
made within the school was +.529 ± .019, foi the oighty-three friend- 
ships made outside of school, +.462 ± .073 It would thercfoic seem 
that the tendency for children to choose friends of their own {ige exists 
independently of school giouping although it may ))c increased by it 

iNTJOLLIGmCK QUOTIENTS 

liilelhgence quotients ol^lamed by tlic Torinan Gioup tests within 
the two previous years weie available fiom Die school recoids foi one 
bundled ninety-.scven of tlie children, one hundied tlurty+oui giils and 
sixty-thrco boys 'Pho eoiudalioii coelheiont was +.332 ± ,043 as 
against a con elation coeflieioiit of + 470 ± .039 foi the chionological 
age. The correlation cocfiicient for the intelligence quotients of one 
hundred eight friendships made wiiliin the school was + 299 ± 069, 
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for eighty-iiinc friendships made outside of the school the conelaUon 
CO efficient was +.374 ± •062. Inasmuch as the con elation coeflTicient 
for the friendships made out of school is slightly higlioi than that for 
those made in school, even allowing for the equalization which might 
occur because of the probable error, the indications would scorn to be 
that intelligence quotient is an independent factor in children's 
fnenclslnps, not simply the outcome of school soelioiiing. 

The mean mfcolligonce quotient for both the childicii and their 
fiicnds was 109 8 with a standard deviation for both gioiips of 16.3 
For those friendships made in school the mean intelligence quotient 
IS 109 5 for the children, 1111 foi their fiiends, with a standard 
deviation of 14.1 for the childien and 14 8 for their fiiends, For 
those friendships made outside of scliool the mean intelligence quotient 
is 110 1 for the children, 108 2 for their friends, with a standard 
deviation of 16 7 for the children and 15.7 for their friends. 

Mental Age 

The mental age of one hundred seventy- two childien and their 
fiiends, of which one hundred twenty were gills, fifty-two boys, was 
computed for the tune of the study rather than for the time at which 
the friondslnp was made, as it did not sconi possible to secure an 
accurate record of the exact time when each fiiondship was foimcd. 
Inasmuch as all the childien studied had boon tested by the Toiman 
Group test within the two previous years it was felt for the purpose 
of this study it would bo satisfaclory to assume that the intelligence 
quotients had remained constant and to compute the mental age fiom 
the intelligence quoLiont and the chronological age at the tune of the 
study, 

The mental age range for both the childien and their friends 
was eleven years and one month to twenty-one years eleven months. 
Seven children had the same mental ago as their friends, thii by-seven 
children chose fiiends with a mental age within six months of their own, 
sixty- two had a mental age more than six months higher than Ihcii 
friends, sixty-six more than six months lowei There seems to be an 
equal tendency for a child to choose a fiicnd with a higher mental age 
as there is for him to choose a fiiend with a lower one. The mean 
mental age for the children was fifteen years and seven months with 
a standard deviation of 22 7 months, the mean mental age for then 
friends was approximately the same, fifteen years and ton months with 
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a standaid deviation of 219 months. The correlation coefhcient 
was + 423 ± .042. 

A conipaiivsou of the con elation coefficients for cluonological 
age, mental ago, and intelligence quotient reveals the following data 
in order of the probable importance. 


Tar LB II — A CJoi\ii»auihon or Tim CoimnLATiON Coni' rieiKNTH or GA, MA and 

IQ 


SiilijeoL 

Cori elation 
coefficient 

PE 

Cliionological age 

H- 470 

± 030 

Mental ftge 

H- 423 

± 042 

Intolligcncp quotient 

+ 332 

± 043 


School Divisions 

The fact that chiUlveu seem to tend toward a choice of friends 
of approximaloly the same chronological age and mental age would 
suggest that these friends might also tend to bo in the same grade 
or section m school. The fclloiving facts bear out this supposition. 
Of two hinuhcd fifty-foui cluldien studied (one hundred twelve boys, 
one liundied fifty-ono guls) one hundred lliulcon of their frioiuls weie 
in the same ficction, sixty-two in the saiiie grade but not the same 
section, seventy-nine in other grades. Of the one hundred twelve 
boys twenty-three or twenty pci cent chose friends in a higher grade, 
twenty-one or eighteen pci cent in a lower grade, and seventy or 
sixty-ouo per cent in the saiiic grade, Of the one hiuidiecl fifty-one 
girls eight or five pei cemt chose friends in a lowoi grade, thirty-two 
or twonty-onc per cent in a lughei grade, one bundled eleven or 
seventy-four per cent in the same grade The boys seem to have a 
higher range of fiiendsliips than the girls, vSi\ty-onc pci cent of the 
friends of the boys were in the same grade as against scvcnty-foui 
per cent of the girls This tendency, if it holds tiuc with a larger 
group, may be duo to Ihc fact that there is a blight tendency for boys 
to make more fnendships in the neighborhood and tluough clubs than 
girls and, as has btjon shown, tho age range for fuendsliips made outside 
of school tends to he slightly higher than foi .school-fiicndslnps. 

Pi/ACKS IN Which tiik TuiKNusinrs DioviiLonoi) 

In ordei to discover whether the scliool, tlie ndghhoihood, the 
club, or otlior eiiviroiiinental factors have the most eficct upon the 
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marking of friendships the following factors (jonccining the places 
whore the fiieiidships wcie made were inYCstigaicd ♦ 

1 School 

2, Neightaoiliood 

3, Club — Girl Scouts, Boy Scouls, Y M. C A , Girl KcscrvCxS 
4 Church. 

5. Miscellancoub — family contacts, special inteiests ---music, etc 
Information was obtained from two himdiod fifty-five childion 
(one himdied sixty girls, ninety-five boys). Table III indicates the 
number of fuendships made in each of these places 


TaulFi III — NuMDP^U op PltlBNDhlllPB IN IlniiATJON »rO TUI] PlACH Wlinuu THE} 

CinnniiEN Mlt 


Place 

Niinil)cr of fiicndB 

Per cent 

Soliool 

138 

64 

Neigliborhood 

03 

25 

Gluircb 

20 

8 

Club 

8 

3 

Miscellaneous 

20 

10 


The tabic shows that the school was the place in which the largest 
number of friendships was madc;, with the neighborhood ranking 
second, A slight tendency was found for the lioys to make more of 
their friendships in the neighborhood and places other tliau school 
than for the girls to do so, Forty-nine per cent of the boys and 
forty-four per cent of the girls made ihoir fuendships in places other 
than school 

Tabic IV indicates that the section grouping has a distinct influ- 
ence upon the friendships which children make within the school, 
whereas for those friendships made out of the school the section has 
very li ttle significance 


Table IV — Relation op Section Guoupino to Puibndsuifs Made in the 
School and Out of tub School 



Friendship iimdo 

Fiicndflhip made 

School division of friend 

, m achool, per 

out of school, 


cent 

per cent 

Same BGciioii . . ... 

04 

19 

Samo grade (not Bnmo section) 

2C 

21 

OthOT grade 

11 

67 
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Factors in CMldien’s Friendship 

Occupation of Parent 

111 ordci to atlompi to cletevminc the influence of the 80 oial-oco- 
noirno status of families upon the fiiendships of the children a compari- 
son was made between the occupation of the father of each child with 
tliat of the father of his friend For llic purpose of the study the 
occupations were grouped into the following four groups, coinciding 
appioxiinaloly with tho social groupings of the community; 

1 Unskilled and Bcmi-Blcillcd labor 

2. Skilled labor (carpenter, electrician, etc). 

3 Semi-professional (nurse, school teacliei, etc.), commercial, 
owner of small ranch or citrus grove, clcucal. 

4. Professional (engmcci, physician, etc), business executive, 
owner of laige ranch or citrus grove. 

Two hundred thirty-seven oases were studied (ninety-five boys, 
one hundred foity-two girls). It must bo lemoinbercd that California 
is a large middle class state, and tlicrofoie the total distribution of 
children is largely weighted toward tho skilled labor and commoiolal 
groups. Table V indicates tho results secured 


Tabuj V — CovpAniBON OF Occupation op Pahent op Chibp with Pakbnt 

DV FiUIjND 


Pnronl's ocoupatloii 

Uiiekilled 

SkiHcd, olo 

Gonimoroinl, 

cto 

Profcaejonnl, 

olo 

Total number 

Per cont of 

Ntim- 

Por 

Niim- 

Tor 

Nuni- 

Per 

Num- 

Per 

q( Qfieco 

totttl nuiabw 

bor 

cent 

her 

cotifc 

her 

eout 

1 bee 

cent 

Unskilled labor 









16 

1 7 

U 

OD 

-1 


1 

0 



Skilled labor, etc 


1 







121 

1 51 

4 

3 

83 

m 

29 

24 

5 

\ 

CommOTomI, ote 









71 




11 

10 

60 

71 

0 

13 

rrofcsBionnl, etc 









30 

13 



1 

3 

7 

23 

22 

71 


These figvuoH woulil BiMMu lo Hiduiiilc thal the aottiahcconoiwic 
slaLus of the ptuonls in tho oomimiiuty ig iiii impoi taut onloriou lu the 
choice of friends winch llie child makes. In each case the number 
of friends chosen from the same socuil-cconomic gioup equals more 
than sixty per cent of the total distribution • 
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Pun Cent 


Unskillod lahoi C9 

Skilled labor, do 09 

Comineioial, do 71 

Profcs'jional, etc 74 


The correlation coefficiont +.716 ± .032 alrongly cxpresocs this 
tencloncy for childioii to chooso fiicnds of the same social-economic 
gioup As thcie were only four gioups the correlation coclfioicnt 
was corrected for coarse grouping hy Shephcid’s fouuula with a 
resulting correlation coefficient of +.817 The coriclalion coefficients 
for the boys and thoir friends and for the girla and tJieir friends were 
practically the same, +.695 ± 030 for the boy gioup, and +.724 + 
.027 for the girl group. 

It seems probable that the significance of the high correlation 
coofficiont IS not greatly influenced by tlio pioximity of the homos 
of the children and their friends, as only twenty-five per cent of the 
children stated that iJicir friendships had been formed in the noighboi- 
hood, It might also bo meulioned that the cluh.s and chuiches m 
lliversidc arc centralized lathcr than located in special residential 
distiicts, so that It is probable that those friendships made through 
those agencies wore not unduly influenced by ncighboiliood divisions. 
There is also a suggestion of a tendency for children to icach into a 
higliei social-economic group m the choice of a friend, forty-eight 
children chose friends in a higher group against twonty-thice who 
chose them in a lower one. 'I'ho facts given show, however, tliat the 
stronger tendency in a child’s choice of a friend is toward those of the 
same social-cconoinic level. 

Play Interests 

Lehman's Piay Quiz was given to one hundred twenty-six children 
(twenty-eight boys, mncty-cight girls) and their fiicnds. Unfortu- 
nately the test was given one week after tiic othci data had been 
collected, and in the meantime n reairangemeiit of school groups 
had made it impossible to roach all the boys who had been studied 
at the original time. The nurabei of boy.s, therefore, is too small to 
permit any definite statement concerning the findings init tlic (rends 
will be of inteicat In scoring the tests the number of activities 
carried on in the past week because the child hked to do them wcio 
checked against those of his friend, and the number of identical inter- 
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Gsts lecorded* The child's inteiesls were then clipclced agniiiBL 
those of cases picked nt inndoiii from the childicn studied, three 
casc^ for each of the gvils, six for each ot the boys. The mean number 
of like intorcsls foi child and fiiend, and child and other than fiicnd 
IS shown in Table VI It would scorn as if there were a slight tendency 
foi the children and then friends to have tlic huger number of common 
interests. 


Taums Vf — M ran Nonnnii oi*’ Likij Intbuests fou Ciiilij anp Fiubnd, and 
C niPi) and Otiidu than Fiiiend 


CllII.DnBN 


IJoya 

Boy and Fiiciul 
Boy and othci than fi lond 
Gills 

Girl and Fiicnd 
Gill and othci than fiicnd 
Boys and Giils. 

Child and friend 

Child and othci than fiicnd 


Mean NtjjinBn op 
Likf) iNTBns&Ta 


15 5 
10 

10 5 
14 6 

17 

16 


A Btudy wan next made of Reckon D of the test m ordoi to diacovei 
whether the child and fnond tend to have pi unary inteie&ts m 
common. Table VII shows that moio children Imd a common interest 
in one of the three Hungs tln^y like to do boat with then friend than 
with the chilchcn picked at lamlom from the gioup. Twenty-seven 
per cent of the children bliuhcd bad one of their three greatest interests 
in common wiili thoir lu'st friend as compared with nineteen pei cent 
who had one of their gicatcst inlcicbts in common with children 
selected at laiidom. 


Table VII. — A CoMPAmBON of Common Primaiu iNTDiiEHTa between Citild 
and FiiinND, AND Child and Otiieu than Fiiiend 


Nami)et of pnniaiy 
mtoiests 1 

Poi cciit of common 
pninaiy iiilcioBts between 
oluhl and fuoiid 

Pci cent of common 
inteicsts between child 
and otlipi tliaii fiicncl 

1 

27 

1^ 

2 


1 

a 

1 
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Bummauy Of CoNuumioNb 

Social-economic Status of Parents — Of tlie faclors eonaclcrod in fchia 
study pi'imaiy importance is assigned to the Bocial-economtc status 
of tlic parents. The correlalioii eoefhek'iit for the Hocial-ccoiiomic 
position of parent of child and piiiont of fneiul was -1-.71C ± 032 
Coi'icctcd for coarse grouping by .Shepherd’s formula the coefficient 
was -(-.817. This higli coirelation does not seem to have been .signif- 
icantly inilueiicod by the pioximity of homes a« only twenty-five per 
cent of the total mimhor of cluldien stated that they iiiiide their 
friends in the neighborhood There was also a aiigge.stion of a tendeney 
for the children to choose fiiends of a higher aocial-ecoiiomic group; 
forty-eight had fiienda m a higher gioup, twenty-tiucc la a lowei. 

ChionologicalAge.—Thc coiielation coefficient foi cliiouologicnl age 
was '(-.470 ± .030. This is probably somewhat greater m those 
friendships inaclc in school tlhildicii lend to choose friends within 
one year of their age. There is no teiideiioy to choose friends either 
older or younger, Tnendships iiuidc in the iioighboihood have a 
larger ago range than fncndslii|)s made m school. 

Menial Age and IntelUgencc Qualieid — The correlation coefficient 
for mental ago was -(■.423 ± 042. 'i’im coriolation coefficient for 
intelligence' quotient was -1-.332 ± 043 'J'lic fact that the iiiLclhgcnce 
quotient correlation coefficient does not seem to be iiiduenccd by 
school groupings would suggest a spontaneous tendency to choose 
friends of the same nppioxunalo iutolligenco 

School Dtvimns and Place of Meolmg — There is an alino.st equal 
division in the number of friendships made in the school and those made 
in the neighborhood or tluough homo contacts, cliiirchcs, and clubs 
It must be lecognized, however, that the school is tlic greatest single 
source with the neighborhood ranking second with twenty-five pei cent 
of the total number of fncndslups. Of those friendships made in 
school the giadc-aeclion divisions seem to be of importance. 

Play Inlemls — According to the data secured fioin Lehman's 
Play Quia there seems to be a sliglit tendency for chihhen to have a 
greater number of like interesta with their best friends than with other 
children. It can not be stated as to whether this common intoipst was 
the cause or outcome of the friendship. 



A STUDY OF CLASSROOM BEHAVIOR 
WILLARD C OLSON 
Univoreity of Michigan 

Considerable mlcrosL lias been shown in rccenL years in the develop- 
ment of tcohniqncft for the quantitative expicssion of personality traits 
not easily amenable to measurement by test methods By the uso of 
carefully defined categones of oveit behavior, lelatively short tnne 
samples, repeated observations, and systematic recording, the writer 
has attempted to accomplish the task of incnsurcmcnt thiough diicct 
observation.^ The adaptability of the gcneial method to a variety 
of behavjoi tiaits has been illustiated by Goodenough,^ The present 
investigation was initiated to test further the applicability of the 
method and to acquaint a class in the psychology of personality with 
its use, 

Whispering was olioscn as the behavior to be observed. Wickman^ 
has shown Hint whispeiing ranks first in frequency of occurrence 
among behavior problems in children, although tcnclicrs do not regard 
its occuircnce in a cluld as a serious behavioi disorder A behavior 
pioblem IS defined fiequently as a disci epancy between the environ- 
mental demands made on an individual and his adjustment to them 
Whispering, according to this definition, may or may not bo a bcliavior 
problem in a particulai classroom depending upon the requirements 
made with respect to it The piesoiit rcpoit ie concerned with an 
attempt to measure and dcsciibe whispci mg behavior m schoolroom 
situations quite apart froin any judgment concerning its desirability 
or undesirability, 


ConiiECTiON OF Data 

Ariangcmonts weio made to peimit the class to spend one hour, 
from 9:00 to 10,00 A M , in obscivation in an elementary school,^ 

Olson, Wilkid C "The MoaBuroineiit of Ncivoiib IlnbilH iii Noimal Chil- 
dren ” Minneapolis The TTnivcrsity of MinnesoUi PlCl^s, 1020 

2 Goodenoiigh, Florence L Monsuiing lichavioi Tiaits by Moans of Repeated 
Sliort .Sampler Jomnal of JitLCinlo ReRcnrch^ Vol XII, 1028, pp 230^235. 

^Wioknmit, K K "C^nldieii'H Uohavioi iind TeaehciR’ AtliUidos New 
Yoik The Comiiioiiwcalili Fund Division of Pnhiinilions, 1028 

*Tho writoi IB iii(hd)tcil to Miss Kalheiino (1 Young, Piincipal of the Miucy 
School, Miiineapolis, foi coopciiitioii in this piojoct 
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Each obsoi’vor was supplied with a mimrographed shoot of instructions 
giving explicit diicciions for making the obwcrvations ^ A whisper 
for the purpose of the study was defined ns an unauthorized oral 
com immication— whispered or aloud— to a person oi persons other 
than the teacher The unit of incasmcmonl was clofmcd as one 
or more acts of wlnspenng per fivc-minutc period. Two observers 
wciG stationed m each room at opposite Hides and all rooms in the 
building studied at the same hour. Oiie student substituted a senes 
of obseivaliona made on a twelfth grade class in. economics. Ton 
successive observations woac made and recorded m a prcsciibcd manner 
on seating clmils of the rooms The total number of time samples 
in which a child was recorded ns wliispering was called his whisper 
score. 

Reltabiuity op Whispeii Scoubs 

The lo! lability of the total scoic for ten fivc-minuto records was 
obtained by correlating the values obtained on each child by the two 
observers in each room The coefficient of correlation between the 
two sots of scoies varied botwccH 20 and .78. The predicted relia^ 
bilities (Spcarman-Biown formula) for twenty five-minule periods 
varied beiwcon 33 and 88 for the grade gioups studied (Table I) 
The reliability of the single observer of a high school class was studied 
by correlating the sum of the odd miml)eicd oliscrvations with the sum 
of the even numbered observations. The reliability coefficient for 
five observations was found to bo .07 with ,80 the predicted value foi 
the ten observations. 

In the room whore the lowest reliability coefficient was found, 
the method of teaching called for frequent shifts in the seating airange- 
ment Since the observers did not know the children except as a seat 
location, such changes introduced difficulties, A gi eater amount of 
time would have to bo spent in such a situation, the room program 
slightly modified, oi the children identified as individuals, to secure 
the requisite reliability It is probable that some initial tiaimng 
m the use of the method would impiove tlio accuracy of the observers 
Increased reliability would be obtained by making a larger number of 
observations 

It was felt that the records obtained showed siiflicicnt consistency 
to warrant further inquiry into their distribution and Bigmficnnce 
In the subsequent analysis, tho average of the records of two observers 

1 Copies of the ins bi notion sheet may be obtniucd from the wi iior upon Tcqucst, 
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was taken as the score for each cliilcl m the elementary school. The 
high school records are the results for a single observer 


Tabmi I. — Rni.TAmi.iTY op WnrarER Sconns 


Group 

N I 

j Tj 10 obfl, 1 

r (Sp, Bv ), 20 oba 

IB 

32 

20 

33 

SU-2A 

35 

78 

88 

u-w 

U 

70 

86 

U-iB 

40 

00 

75 


36 

43 

60 

Gfl 1 

31 

20 

45 

6/1 

30 

36 

62 

12 

27 

80 

80 


Distribution op Wiiibi'er Scores 

Under the conclitiona of the method, the child who whispered in 
each of ten fivc-minuto intervals would have n score of ten, while the 
child who did not whisper nt all would have a score of zeio. Scores for 
the elementary grades (Table II) varied between zero and eight, 
with a mean manifestation of 2 2 Since the score foi each child 
m the olemontary scJiool is tho average of lecords fioin two olworvers, 
the vaiiabilitios of the scoiea are snmewhal curtailed. An oxaimiialion 
of tlie table reveals the piescncc of a large nuinbei of zero values 
In a sense, tho method fails to difTcroiiliatc about 33 per cent of the 
elementary grade cluklien. Piovious cxpcrionco with the method 
in the incnsurcinent of other typc.s of hchavioi suggests that added 
observations arc needed in oidcr to fui llior diffcrcntiato the zero scores. 
The scoies for the single observer of tlic twelfth grade vary between 
zero and ton with a mean of 4 5 and i datively few zero scores. 

No reliable sox differences appear m the table. Although the data 
were sexed for purposes of analysis, the lack of any constant trend has 
led the wiiter to deal with only tlie totals in the remaindei of this 
report 

Relation op Wiiispeu Scores to Guape in School 

No clear-cut relaLioiisliip between tlie mean amount of whispcimg 
and tlie grade in school can bo domoiistratod with tho number of case.s 
available (Table III) Tho data suggest a largct amount in the first 
grade Ilian in subsequent grades in the elementary school On tlie 
other hand, a previous table (II) shows an almost equal amount in a 
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group of high school seniors. It would appear that the gross amount 
of whispering in a particuJai gindc is a function of tlic situation rather 
than the reflection of any fundamental developmental continuum 
Deviation fiom the mean of a given bilunlioii is probably of more 
significance than the raw score Such fluctuntions as arc found from 
loom to room cannot be attributed solely to criois of measuiement for 
two observers tend to give siniiler descriplions (Table IV) 


TAUnn II. — Dihtiuboi'ion or WiuHviiu iScorkh by Ki.x 



Elementary graclo8‘ 


12th grade 


Scoica 


— 

_ 1 

- - - 






Girls 

' Total 

liOJ'S 

QjrJs 

1 

Total 

10 





2 

2 

0 




, 

1 2 

2 

8 

1 


1 




7 

1 

4 


1 


1 

C 

’ 2 

‘ 3 

1 5 

1 


1 

5 

6 

4 

10 

3 

1 

4 

4 

0 

6 

11 

3 

1 

4 

3 

19 

13 

32 

6 


6 

2 

16 

13 

28 

2 ! 


2 

1 

27 

30 

67 

1 

1 

2 

0 

32 

43 

76 

1 

3 

4 

N . 

109 

116 

224 

17 

10 

27 

Md 

1 8 

1 6 

1 0 

3 0 

5 0 

4 1 

M 

2 3 

2 1 

2 2 

4 0 

5 3 

4 6 


1 8 

1 0 

1 8 

1 7 

4 2 

3 0 


^ Cnsea without age records omitted from this tabulation. 


WiiisPEniNG, Intelligence, and Sciioql Achievement 

Intelligence quotients, based on a single group test, were avail- 
able for children in the 6A grade. The coeflicicnt of con elation 
between whisper scores and intelligence quotients was — 34 + 11 
Intelligence quotients, based on the mean of five group tests, and 
honor-pomt ratios, based on all marks for tliiec yoais of high scliool 
worlc, were available for the small gioup of high school soniois. The 
mtcrcorrelations ai c presented in Table V. The i elationshi]) of whisper- 
ing to honor-point ratios ( — 30 ± .12) is higher than that with intelli- 
gence quotients (*- .17 ± 13) Data on linger gioup.s mo necessary to 
establish these trends with certainty. The ovidcnco available suggests 
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that whispciing la not simply an adventitious circumstance, but is a 
reflection in pail of adjustment to the classroom situation The more 
ijitelhgent and scholarly, interested in the ivork of the class, adjust to 
it and whisper less. It is conceivable that the lolationslup would 
change under vaiying conditions of work and interest 

Wni8PKUIN« AND MaUKB IN CONDUCT 

In a sense, tlio validity of the wliisper scores is intimsic and relia- 
bility and validity cocflicients become synonymoua for the narrowly 
defined bohavioi wlncli is the subject of study. If now a claim is 
made that the whisper bcoics aie symploinatic of bioador categories of 
bcliavioi , external criteria must be used to evaluate the method 


TaBI/E III — WlIIHI'llU HcOHBS IlY (’illADCS IN AN EIiBMENTABI SoiIOOli* 





Giadca 











Total 


1 1 








2A j 

3/i-3A 

[ 4li-4A 

6/3 

6 0-0 A 


N 

30 

10 


40 

22 

69 1 

224 

Md 

4 0 , 

1 0 

[) K 

1 8 

0 8 

1 3 


M 

4 8 ' 

2 5 

1 .1 1 

2 0 

1 2 

1 8 

2 2 

SDdi. 

1 5 ' 

2 0 

1 f) ' 

1 4 

1 0 

1 3 ' 

1 a 


1 Cases witlioul iccoids omitted from this tabulation 


Tath-ii IV — CoMPAitisoN or Mijan Hcohks and Vaiuaiiimty or Two OnsDnvKns 

IN Each Coahhiioom 




Mean . 


Room 

N 

Ohfloivei 1 

i 

Obsfii vor 2 

[ 

Oiiserver 1 , 

1 

Observer 2 

113 

32 

6 r> 

1 4 

2 0 1 

2 0 

2A-3B 

33 

2 9 

2 1 

2 7 

1.8 

iB-'iA 

40 

2 0 

2 6 

1 6 

1 4 

GA 

30 

2 i\ 

2 6 

1 0 1 

1 9 

GD 

31 

1 0 

1 2 

1 2 ' 

9 

313-3/1 

34 

1 4 

1 2 

1 7 

9 

4/1-6Z3 

36 

1 4 

1 0 

1 2 

7 


Ohiklicn in the ('Icnieiitaiy seliool htiidiod woie given maiks m 
conduct by teachers in gnulos lluoe and above The nuiiks weie in 
teims of letter latings, ^■1, li, C, 1), and li'. Tlie summary for a 
semester was taken as the mark for each child Tlicie is a suggestion 
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that the s)gniricaiice of wliiapenng as one of the criteria of conduct 
incieasea as one goes fiom the ficctloin of the early school years to the 
more formal procedures of the upper grades (Table VI) 


Table V —REUTiONfliiiP iij.tweiin Wiimi’nii HrouES and Otiiku Vauiadleb in a 
Iliau School Clabs {N = 24), Pkii Gent 



ICi ' 

IIP ftVP. 

C\ 

Whisper 

- 17 


18 

IQ 


(18 

- SB 

HP Avc 



- 31 


Tadld VI— Tub IIelation oe Wiiismii Scobkh to Makkb in Conduct in 

SuCOEHfllVE CillADES 


Oradc 

N 

r 

6A . 

20 

- 60 

5A-6P 

30 

- 30 

4B-4A 

30 

- 08 

3/L-4B 

30 

10 


SiJMMAUY 

A group of students in a coin so m the psychology of peisonallty 
collected data on the occurrence of whispering m clementniy and high 
school children by the use of a time sampling technique. Each student 
made ten consecutive five-minulo observations The lehabiHty 
coefiicientB for the average of two iinpracticcd ohsei vers varied between 
.33 and 88 in the rooms studied. No significant sox diffciences 
appeared in the mean whisper scores. The amount of whispering 
present in the various grades appeared to be a function of the situation 
rather than the reflection of a developmental trend The evidence 
suggested that the more intelligent and scholaily whispcied somewhat 
less than other children. The significance of whispering as one of the 
criteria entering into marks of conduct increased with the grades. 








REPLY TO PROFESSOR KELLEY 

KAIIL J, IIOLZINGEIl 
TJiiivoiflity of ChiPftgo 

In the May issue of tins Join mil Professor Kelley has taken objec- 
tion to some comments I have made' rcKaiding an example taken from 
his book, "Crossroads in the Mind of Man ” 

To save print I icfor tlie render to the data in the papers cited 
above In ray Maich paper 1 liiod to do the foliowuip; tilings- 

1. Show tliat TJioindiko's (JAVI) mtolhgencc test has a common 
factor with three othei tests and doteiimne its coil elation with this 
fftctoi ‘ {) If = 96) 

2, As an ojiamplc that a "pavsimoinons" explanation of coirolations 
IB desirable I took four out of nmc tests fiom some of Piofcssor Kelley’s 
data and found one common factoi an adequate explanation, I 
then gave Profe.ssoi Kelleys’ jiatteru based on tlicso four tests and 
five others. Tins pattern was veiy clahoiate, having one common 
factor, thioe substantial group faetois and .several specific factors 
On p. 164 of iny ai tide I .say, 

The above oxnn)|>l(' m biit n Jragmeiil of Piofcssor Ki'lloy'e woik on tlicac data 
and IS not included by way of cnlieisin, but ineielv beoaiiBO the luiincrnl work 
was (it band Ah far ns these Jour leuls are eoncernod wc hold that pattern (1) 
IB adequate. Piofcssor Kolloy omplovs Ibo elaltouite paltoiii ui llio above table 
and inlorpictB the common factoi a ns "hctoioKcncity, matuiitVi scs, mid race ” 
Wc (irgiie that the faolorH a, li, y, S, c, f, etc aip mHigiiificnnt in these four teats, 
and that wlmlovcr eominoii factor is found inav be legaidcd ns o (Italics added ) 

Professor Kelley (he vd ) ciiarges mo with the following orroi.s: 

(a) A false picscntation of his argtiinent because otiicr elements 
of the pioblorn wcic not considered (p 306). 

(!>) Unawaicness that when moio vaiiablca aie added to a given 
sot the pattern explanation becomo.s more involved (p 3C5) 

(c) Overlooking thi.s point in tlie interpietation of CAVD (p 
366). 

(d) Implied charge that I (or people like me) would take four 
tests with common (/, then take foui other to.sls with a common (/' 
and from these two lesults say (/ = (/' (i) 3(H)) 

• Ilolyniger, Karl J Tlionidiko’a CAVD m full of 0, Jounuil of Ediicaltonal 
Psychology, Maich, 1031. 


m 
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Witli legard to point (n) I may say tiuit 1 was aware I had taken 
only a part of Professor Kelley’s data lOvulcuco of such awareness 
IS in the paragraph cited above. I was not presenting any argument 
of hia ciihoi falsely or othorwiso 

I am aware and was aware of the fact that when more variables 
are added to a set, the factor pattern may bocomo inoic coinphoaled. 
Tims, if wo have an. explanation for four varialilcs rj, 12 , .'Ja, and 
this explanation may not suffice when we add re Professoi Kelley 
notes that we may get a gioup factor belwoon .Xi and .tb He does not, 
however, explain how the arUhlion of more variables to the original 
tests with no group factor, iiilroduce.s sovcial gioup factors in Ike 
original foim. An explanation is possilrlc, and would liavc been 
more to the point than tlie aitificial data m his 'I'alilc I, p 305 

As jogiirds the CJAVD le.st I see no justification for the chnige that 
I was unaware tlial othei to.sls might have given a cliiTi'ront result. 
Profe8.H0i’ Kelley’s icmnik on p. 3GG is paiLiculaily inisloading “To 
gonorabze from the relation, ships found in four tests io ri'lationships 
supposed to lio in the mind of man begs the que.stion, for doing so 
involve.? the assumption that the four tests nainple the ontiie mental 
life ’’ I agree with this quotation as a staleincnt of a geiicial principle, 
but not if It IS applied as a ciilicism of what I have done with the (JAVD 
test and thice otheis (which were all Professor Thoriidilco fuiniBliccl 
me). Note that if the nuinbor “nine” bo siihsliluled 111 place of the 
number “four” in this quotation, the same' criticism applie,s in less 
dcgiec to Professor Kelley’s own data Suiely the moie tests wo have 
and the more ncaily they cover the areas of inouLal life, the hotter the 
opportunity foi a complete picture of such life 

My own bludy showed that OAVD is full to the, extent r = 96 
with the same thing that three other .so-called lutclligcnec tests con- 
tain to a large extent On p 96 of his mcasuioinont of intelligence 
Piofesaoi Thorndike makes the following mfoience from the same 
correlations I employed . “Intellect OAVD is very much the same thing 
as that which is mensuiod by repiracntativc examinations for so-called 
mtelhgOnce ’’ All I have done is to show the same fact moie precisely 
and to indicate how much OAVD is saturated with this '‘same thing’’ 
present in otlier tests of so-cnilod inlclhgciico. 

The charge that someone might siiy (/=(/' when these two aic 
obtained from different tests is too absent io more than recognize as 
such 



457 


Reply to Profesm Kelley 

I may say in concluaion that I am much more interested m getting 
at the truth about factor analysis than in getting the bettor of an 
argument. An argument, however, may bring to light the cruoml 
aspects of a theoiy a little more vividly than one sided pieseiitation 
The point heio empliasiaed I believe to be, that factor pattoina are 
functions of the lc,sts we use They are also functions of the groups 
we test and of many other things. JCxcept foi this point 1 shouldn't 
have written tlits reply becau.se I am certain Professor Kelley and I 
are in substantial ngtecineiiL on all points at apparent issue 



THE INFLUENCE OP JAZZ AND DIRGE MUSIC UPON 
SPEED AND ACCURACY OP TYPING 

MILTON 15. JENHEN 
Woatorn Konli«*ky Suite Toiiclieis College 

Tina aludy wna miulc at the "I’laining Heliotil of the CVntial Stale 
Teachcra College, Michigan, tlneo weeks heforii the close of the spring 
scmchtoi’, 1930. Fiflii, eieveiitli and twelftli graclois (twelve boys 
and thiifcy-cight girls) in three typing cla.ssos numbering seventeen, 
seventeen and sixteen lespcctively wore used as subjects All had 
had* tliirty-sevcn consecutive weeks of typing instiuction in the high 
school In ago they ranged from fifteou to twenty-two years (average, 
17 88). Speed and aociuacy wcio measured under tiucc conditions, 
heioafter called slates of distraction: 

I. Notmal — This wa.s iclalively free from disti’actlons, being 
typical of the regular class procedure I’assing through the coiridora 
was infrctiiicnt during these pcruids and thoio tvcrc fow of tlic noises 
common to schools in many of our po|)ulatioii ccntcis Whothor this 
latter fact means that our subjccls were more susceptible to distraction 
than they would be undci city conditions wc cannot say 

2 During the Playing of Jazz Music on an Edison Phonograph, 
Cabinet Model. — A heavy steel ncodlo was used in playing all the 
lecords, the tempo was kept normal and no changes wcio made m 
volume control. The jazz selections wore: “ Valencia,” Perfect Record 
//14626, played by the Mnyflowor Scronailers, "At the Piom," Victor 
Record //38105A, played by Irving Mills and his Modernists, and 
"Bugel Call Blues,” Victor Record //38105B, played by Jack Pettis 
and hia Pols. 

3. During the Playing of Dtige Music — The selections lepioduccd 
were “Death of Ase,” Victoi Record //35470B, played by the Victor 
Conceit Orchestra, "Thais Meditation,” Victor Record jJ^filSGA, 
played by Fritz Kreisler accompanied by Carl Lamson, and “Indian 
Lament,” Victor Record //0186B, played by Fiitz Krcislcr accom- 
panied by Vincent O’Buon. 

PrncliGO effects wcio controlled by testing each of the tbree classes 
separately under all throe eonditions on tliicc hucccssivc days and vary- 
ing the order of testing so that, wiien the data for the tin oc clnssc.s were 
combined, equal amounts of practice would acciuc to each mctlioil 
Thus class "A” was tested in tbc ordci : Tuesday — normal, jazz, dirge, 

46S 
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Wednesday — jazz, thrge, normal, and Thursday — dirge, normal, jazz 
Class “B” was tested in the order; Tuesday— jazz, dirge, normal; 
Wednesday — dirge, normal, jazz; and Thuisday — normal, jazz, dirge. 
And class “C” wu,s lestod m the oidci: Tuesday — diigc, normal, jazz, 
Wednesday—normnl, jazz, dirge; and Thursday— jazz, diige, normal. 
Since the cla-sscs wcie appioxnnately ociual m size and since the testing 
all came at the same houi of the day, this procedme may be thought 
of as supplying an adequate control of practice olTccts 

Throe separate five minute typing tests were used, all being admin- 
istered in the same order to each of the classes each of the thiee days; 
Tost No. 4, p. Gl, "New national Typcwiiting" by R. P. Boielle, 
published by the Giogg Publishing Co , tests put out by the Royal 
Typewriting Co. in May, 1029 and April, 1930. Estimates of the 
reliabilities of those tests were .secured by con'clatiiig llic scores of the 
students in words per nimuto aiul applying the technique devised by 
Di Shen m 1924 ' These icliabihties in the older, Sorello, Royal 
1929, Royal 1930, wciot under normal conditions, 62, 74, .67 (av., 
.64); during the playing of juzz, ,89, ,56, 68 (av , .71); duiiug the 
playing of diigc, 70, 85, ,46 (av,, 67). 

It will be seen that thchC cxaimuations aio iiccuinte enough to 
justify their use as nioasuros of group diffeiencos Assuming the 
I’clmbihty of caeh test equal to the avciago of the three tests, for each 
of the tliicc slates of distraction, an application of the Spcaiman- 
Brown foi inula gives a iclmbihly of .84 for an avciaging of the tost 
scores under noiinal conditions, a reliability of .88 duimg the playing 
of jazz, and of .80 during the playing of diigo music * 

While the dihcrenccs in these csiimatca of reliability arc of no gieat 
statistical importance they do show that the acciuncy of our measures 
is not impaiicd by the distractions used What change thcie is, is in 
the direction of improved accuracy — an increase of 04 with jazz over 
the noimnl and of ,02 for diigc over the normal. 

Since typing icsuUs, traditionally, arc measuied in words per 
minute the e(Tccl.s of the distinctions upon the reliabilities of the tests 
weic determined in this unit. In dctciimning the effects upon student 
porfoimance, howcvei, we have cxaimnod the speed of sinking the 
keys (luiinhcr of slroke.s) and tlio iiunilier of crroi.s scpaiately. Table 
I gives the average nuinbcr of aliokea, euovs and woids per inmutc for 

' Slion, E I’lie Ilclialnlily CcollloK'iit of IViHoniil RntniBU Journal of Edti- 
calwnal Paychologi/, Vol, XVI. 1025, pp 232-230. 

* Kelley, T L, “StnliBliuul Mclhoil,” p 20.5 
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each of the three states of disti action, toKcllicr with the probable errors 
of these means. 


Table I — AvniiAOi) NwMni.n ov Stiioklh, Kuhoiih anb Woims piiii Minute Pon 
Typino uNitnii Tininn S-rATba op Disthaction 



Normal 

Jazz 

Dirge 

Strokes 

215 08 h 3 70 

216 80 3 82 

200 (10 ± 3 2fi 

Enors . , 

Q37 1 040 

1 212 1 082 

007 ± 063 

Avoids 

33 04 1 02 

31 00 LI 04 

32 03 i 80 


It 13 scon by inspection that jar//, music had no appreciable influence 
upon the typing speed of our subjects ns incnsurcd in sliokcs per min- 
ute. The dirge, however, brouglit about an average decicase from the 
normal of approvimatoly five strokes per minute — 2.37 pei cent 
This mean difference (5.09) divided by its standard eiror (2 41) gives 
2.11. In terms of normal probability areas, the chances are nine 
hundred cighly-throe in one thousand that the dirge as a distraction 
decreased the speed of striking the keys When the number of errors 
per minute of typing is cmmined, however, a diffciont picture is 
presented. The dirge, wluch materially icduccd the speed of striking 
the keys, actually reduced the number of cnois, leaving the end lesult 
(number of words per minute) little dlffeiont from the normal. Jazz, 
as a distraction, raaikedly increased the number of errors— 5C per cent 
as against .44 per cent foi the normal. The mean mcroaso in eirors 
per mmuto (.275) divided by its slandaul ciroi ( 038) gives 7.24, 
leaving no doubt as to the seriousness of the influence of jazz music 
on typing, so fai as cirois arc concerned. The mean number of words 
per minute is not appreciablj'^ lowoi with dngo ns a dusti notion than 
under normai conditions, but jazz, despite its lack of effect upon the 
number of strokes per minute, seriously affects the final score m woids 
per mmuto, because it is conducive to cuor. Oui subjects, on the 
average, typed 2.68 fewer words per minute with jazz than under 
normal conditions — a decieaso of 7.67 pci cent The standard cnoi 
of thiB diffcrciiGc is 796 so that the diffeicncc (2.58) dividod by its 
standard on or is 3 24. 

In examining the relationship between speed and accuracy, the 
number of strokes and the numbci of crrois wcio coiioliiLcd (product- 
moment) for the thiec stales of distiacLion. They woi-e found to bo: 
under normal conditions, - HI ± .094; with jazz, — 191 ± 092; with 
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diige, -.508 ± 080 Had our populations been linger, more extensive 
examination would have been made of the ranges of ability most 
seriously influenced by distractions of this sort The relation between 
speed of typing and suHCopliliility to distraction is a problem of con- 
siderable impoitanoo to botli the bvisincss man and the educator 
Unfortunately, our data cannot solve tlic piolilcm as the writer should 
wish 

It 18 of mtorest that siiocd and eiror urc so little lelalcd under 
normal conditions A plotting of the percentages of crior given in 
Tabic II shows a niarketl ri.si* tliroughout the middle deciles as opposed 
to ft gradual dropiuug off which one might be led to expeot, Tins 
situation 18 even more inarlccd willi jazz as a distraction. With the 
dirge the tciidoncy is still piesent but the decrease comes earlier — m 
keeping with the stioiig negative correiation between speed and error 
under this typo of distraction. Talile II gives the mean iiuinbor of 
strokes per minute and the mean porccnlages of error for the deciles of 
the distribution under each of the throe states of distinction. The 
decile ordei is the same throughout ns under normal conditioas, no 
changc.s being made for (‘hangod positions with jazz and dirgo as 
distractions 


TAai.BlI — MvixN tHTiioi usiu.w Minute and Pmicentaohs of EiuionnY Dbciles 
lou Tiiio.i. .States or Distraction 



NoiJiinJ 

Jn/K 

Diigo 

Dcoilo 

SlroKcH per 

Vor oont 

SlTukcB per 

IVr cent 

StrokcR pur 

Per Gent 


iiuimto 

oiror 

ininuto 

error 

mimito 

enor 

1 

MO 8 

45 

M8 2 

59 

50 0 

64 

2 

170 0 

42 


44 

181 8 

46 

3 

1B2 0 

40 

200 3 

78 

180 7 

30 

4 

202 2 

55 

lOG 7 

77 

190 4 

49 

6 

20B 2 

5S 

208 5 

,00 

201 3 

69 

6 

215 8 

50 

216 C 

69 

208 7 

62 

7 

224 2 

08 

222 2 

.07 

213 4 

58 

8 

231 8 


234 2 

39 

228 7 

32 

0 

265 (i 

17 

247 0 

20 

243 8 

36 

10 

2»1 4 

*21 

285 8 

36 

272 1 

27 


('.ONl'I.imiONS 

Music is a feoiioiis distinction to typists uiulcr tlic conditions 
employed in this study. Jazz and diige were used because lliey are 
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cxlromcs. Other types of inusjc might bo expected to have effects 
intermediate between the influences of these two It seems reasonable 
that any peifoimance calling for rapidity and skill of movement will 
meet interference from stimuli ns intiiuliiig ns the extremes of jazz and 
dirge employed in this study.* The magmlude of this interference is 
indicated by our results. To what extent accommodation might 
offset the distraction over a pi oti acted period of tunc, we have no 
measure The safe proccduio, where speed and accuracy are 
demanded, is to avoid distinctions of tins type unless it can be demon- 
fitratecl that accommodation has taken jilnco to such an extent that 
performance will not bo materially affected 

* The wiiterhas mndo aiireluninnry ntuily of the effects of the radio upon simple 
anthmotic eoRiputations. Data for sixloen Bubjccls nddiug Binglo digit numbers 
during sixteen fitteen-inmuto evpciimcntn! periods (eight with the indio and eight 
witliout — alternated to oliviatc prnctieo effects ond distributed over eight days) are 
strictly in keeping with tho lOBiilts obtained from tlio typing classes, Speed was 
not materially alToctcd but theic was a deeienso of eight in tho iierccntngo of 
accuracy — ninely-lhreo per cent of the additions attempted without the radio were 
correct and only cighly-fivo per cent of those nttemi>tcd with the radio going were 
correct 



A PROOF THAT THE POINT FROM WHICH THE SUM 
OF THE ABSOIAJTE DEVIATIONS IS A MINIMUM 
IS THE MEDIAN 


PAUL IIOIWT 


Peraoimcl ilesnuicli Dppuitmcnl, Uniicd .Statos Civil Hoi vicp Commiaiion 


It 18 quite RcncraUy known Hint the inodian value of a statistical 
series 18 that value fioin which the sum of the absolute deviations is a 
nunimum. ElenieuUuy liandbooks on statistical method sometimes 
refer to this fact hut since they me not concerned with derivations, 
they oiler no niatlioiiuiticnl proof. Botli Yulc^ and Kcllcy* demon- 
strate the truth of tins slatoinent by showing that the absolute 
deviations would lie greater if taken from nny other point than the 
median 

The writer rather incidentally discovered a proof winch is more 
clean cut than any lie lias seen, and it might be of some interest to 
others Instead of Showing that the sum of the absolute deviations 
would be greater if inea.suied fioin any other point than the median 
wc may show with a nioie giMicral apinoach that the point horn Avhicli 
the sum of the alisolute deviations i8 a ininiinuin is the median. 

First wc dcuvo the general expiession for the average deviation 
from any point. Wo have given a statistical series, 

X.\, Xi, Xn, Xmi\i X,n\^f . , Y,, 


arranged in order of inagnitudn, whore all the values up thiough X,„ 
he below any point 1\ and all the values above X,,, lie above this point. 
Then the average deviation nlionti’ will be, 


Al),. 


1 

N 




wH 1 


V 

N 


ml^ — — (a - frt)P + ^X, 


in -I 1 


ADp = 


N 


X 


m 1 \ 


( 1 ) 


which 113 tho saino as foimnla (8) Rivon by Kolloy,^ 

^Yulo, G, U, ''Tiitioduutirtn to tlin Tliuoiy of Statistics^* V Ml 
* Kelley, T L . MuUiod ” P 7*1 

MCcllcy, T L , “iSUtistical Mrthod " P 73 

403 
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Now WG wish to dcteimincP in (1) so that AD/, will be a minimum 
To do this \\(^ simply dilTerenlmie (1) with respect to P and equate the 
derivative to zero. Tlius, 

diABp) _ _ 

” AT 

Thou solving foi m in terms of n wo have simply 

7)1 = ^ 2^1 

That la, half the values aio l)clow P and half above, which is, of course, 
the definition of the median, llciicc that iioint fioin which the sum 
of tlio absolute deviations is a niiniinum is tlie median 


(2) 



RELATION BETWEEN USE OF DIFFERENT PARTS 
OF SPEECH IN WRITTEN COMPOSITION AND 
3 MENTAL ABILITY* 

CIIAIIJJ5S P LOOMIS AND ANNA MAY MORAN 
Nortli Oaiohna State C(jlle>?o of AKriciiUuiP and EngiiipormR 

Since speech is iisctl duecUy or inchroctly moie than any olhoi 
single luiimin alliibutc us u entorion by wliich to cloleiniine individunl 
mtoUigencc, it would appear advantageous to ascertain the relation 
of speech to mental ability fioin every possible angle. Most mtclh- 
genco teals at the present time deinaiid cither speech reactions or 
reactions to speech stimuli, or both The problem undertaken in 
the present study is to discover the relationshiji lietwcen the propor- 
tion of cliftevent parts of speech m writing vocabularies of mdivuluala 
and their mental ability 


I 

The importance of IniiKiiuge iii hiiinaii activity is stressed by most 
paychologlsls, sociologists, and cultural uiithropologisls It is gener- 
ally considered to bo the chief vehicle by which the oxpoiiencc of the 
past and present is transmitted. Speeoh has made liumnn culture 
possible and man a “ time binding animal ” To quote fiom Profcssoi 
Cooley: “Language ih the veluclc by whicli human relations exist and 
develop — all the symliols of mind, together with the menus of con- 
veying througli space aiul piosorving them in time, expiession of fact, 
attitude and gcstuic, tones of voice, printing, and everything m the 
way of mental giowth, has its oxistoiico therein AVilhout language 
the mind does not develop a iiuo human nnluic, but remains 
m an abnoimal and non-de&cnpt state neither human nor piopcrly 
brutal, 

So clo.scly 18 language ie,lalcil to intelligence and the piocesses of 
developing mental ability, that it is believed that if one could inoasuie 
an indivKlual's language ability he would liavo a fair index to that 

‘ The nrtielo is n Hiimmary' of a nuiHtt'r'B thoais picsnntcd at tlin N C State 
Collcg;o, uikIoi' the duocUoii of l)i Karl G. Gauiscm, ProfosMii of Educational 
Psychology. 

•Cooley, GliatU's Iloitou’ “Hocuil ()igaui«itiou ” Glmilcs Hciilinec’s Sous, 
York, 1000, i> (12 



460 


The J<)m}ial oj Kdiunlwiud P.si/cholv(iy 


individuiil’s gpiioral luontid aljility “It lias often been said that 
thought would be impossible wiHiouL words, nnd it is true that we can 
hardly conceive of human thought savi* us formed and cinhodietl and 
expressed m language TIvoughI and aitumlate speech gicw up, so 
to say, side by side; each implies the otliei , l.hey aie two sides of the 
same phase of mental development 

A gicat many sUidies have lieeii made to determine the relation 
between vocabulary nnd speech ability and general intelligence For 
instance, Tciman found eorielalions ranging fioni SH to 1)5 between 
his vocabulary test scoi es and the seoi os made on tlio Htanfoi d Revision 
of the Binet lest." Lockwood* found the con elation bet, ween composi- 
tion gcoie.s based upon (he Iliidele.son sealo and llie wniestor giiidos of 
ficshmen to be .77 ± 029. Lockwood also found a correlation 
between general inlelligeiieo (Otis test) and coinpo.sition scores of 
fifty-.soven boy.stobe 67 ± 05, and of foity-lliiocgiilH to be 70 ± .04, 
and concluded that a high degiee of nitclligenec i.s dnvclly related to 
ability to wide adequately Sangien* arrived at a snnilar conclusion 
aftoi a study of ninth grade pupils; but Boss,'’ wlio Htudied twelfth 
gratlo pupils of siiperioi nicntiil ability, leporleil a laelc of coirelation 
between intelligence and aclueveineiit m Kiiglisli composition. 

(lloser to tlie problem at hand is the iiiiiilysia and classification of 
different parts of speech used at difleieiit )htio(1s of langunge giowth. 


^Titchciioi, E B “A Jk’Ruincr’H Psychology Thr* MfUMiiillnii Company, 
New York, 1917* 

hmm M cl nl “Goiirho Studios of (ImiiiiH," Volunio I SUnford 
Univcisity Press, 1925, p 25 

® Lockwood, II R : Conolalion of Mental Maturity of One Hundred Gollcf^e 
Frosliinen and Thou Ability to Wnte EiirIihIi Composition UnjmhliHhcd Mailer's 
thesis, Bepartmont of Education, TJmveihity of Clue ago, 1025 

Anionp; Btudics of this kind aio those of Hughes, \V H The Relation of 
Intolligoiiec to Vocabulary and Langiiap;o TiaimriK EngJmh Journal, Vol XIV, 
Oct , 1925, aad Bullei, A D* IntelliReneo Tests and Aolucvemeiit in EiirIisIi 
C omposition, Educational Admumltaiton and Supervision, Vol XIII, Jan , 1927, 
and Gairison, K C . Tho Rolahon^liip heUveen Thiee DifTrrenfc Voenbularv 
Abilities Journal of Educalional Research, Vol XXI, Niiiniiei 1, Jan, 1930, pp. 
43-44 

'‘Sangren, Paul V • Iiilclhgence Tests nnd the CluHsilieabon of SLiulents in 
Ninth-grado English Educalional Administration and Supervision, Vol IX, Dec , 
1923, p 547 

^ Boss, Mabel E * Tho Relation of PoifounaiKe in Minilal T(‘Hts Ui Aoliievoinenb 
in High School English Unpublished Mastcr*R thesis, DopaUnient of Education, 
Uiuvoraity ol Minnesota, 1925, p 89 
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In this icgarcl, discrcpancios in the cinssificalion of certain portions of 
language activity have arisen liccansp of the tlifiiculty of assigning the 
pmt of spoccli to the same word or expression under different condi- 
tions A suinniaiy of the litciatuie on Iho relative number of the 
various pints of speeoli was made by 0. W Waddle, tn 1918, with 
the following riiidiiig.s.* 

1 Iiitorjocljonal Hi) 0 cch \viih c IjhuioU'iihIic at tho hoginmii^ 

2 wt^ro iisod (Huly m relatively liufto auiuUcrs 

3 From tlio fuab 3 oiii on, tin* vfThnl oloinoiit wub iclalivolv laigo 

4 The piapoitioii of ntl]f’(‘Uvcs to advoih'i fivoatcr at yoiniRor aRCs 

5 PcHOiml pionouns, n‘lalivo pionouns, and HuhouIinatJng and connecting 
woids, woic acciuiKMl with didicidty. 

These studies, howov(‘Vj have been confined to the investigation 
of the (powth of the use of the diffeieut parts of speech Doyd,“ in 
Ins study on the dovelopUK'nl of Hciitcncc structure in childhood, 
devotes a section to Liu* elements in the vocabulniy, lie says. '^Com- 
ing now to the words which are components of clauses and sentences, 
we may coiisidei the i(‘lulive pi'rcentages of tlio> dlfCcicut parts of 
speech in tlio total woids of the colled ed sentences of the child (count- 
ing each word eaidi lime it oeenrN) ’’ 

The peicenlages of (he (lin(‘reiit parts of speech of the child studied 
by IJo 3 ^d do not dilhu gusUly from those of the study which follows, 
hut they aio classifKsl dineiently, Ihs companion of the vaiious 
pai ts of speccli usesl by ( he p;rowing child with tliose of male and female 
novelists i>s inteiestiug, The iieicenluge, of lelaliomd words (conjunc- 
tions and prepoMlions) in adult sentmices are quite highci, but the 
pciceniago of veihs and adveibs associated with them is considerably 
lowci, Nouns and pioiiouiiH togethei aio of about the same fic- 
qucncy in childion and adults Adults tend to use more nouns than 
pronouns, but the cluldien use iiioie verbs than the novelists There 
was not much difforenco belween the men and women novelists with 
iGgaid to percentage of parts of speech used, 

In a iccent nionogiaiih, Symonds and Leo picsciit data gatheicd 
for the piupose of analyzing*; tlie development of vocaliiilary usage in 
written compnsilion, and (o deteimim* lli(’ cluingcs that occur m the 


MYadtllc, CJ AY ' ‘'An liiimdiiclion to (Jhild Psvdiulogy “ IToiigliton-Milihn 
Compan^^ Boston, 11)18, p 71 

Boyd, William Uulish Jom mil of XVII, 1027, pp 181-101 
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use of words as tiic child bc'coiiw'.s tnoie and more innlme. In their 
conclueiou they say: “It was surprising that the per cent of changes 
are so slight. A few basic articles, conjunctions, pioposilions, pro- 
noiuiB, nouns, and vcibs seem to be theframewoik of the language and 
arc used whenever language is u.sod,’’ * One might anticipate from this 
conclusion that there would he little vaiiation in the proportions of 
difTcrcnt parts of speech iiscil by different ages ami intelligence This 
was found to bo somewhat true m the present study, hut theio was 
enough variation about the avciagea to wairant fuither statistical 
ticatmcnt involving correlations. 

In a study of high school pupils' vocabularies, O'Brien^ found that 
the number of adjoctivca used by students incrcasod steadily as the 
school grade increased. This was also found to bo true of woids or 
pliiases pertaining to abstract qualifies or ideas. He states that 
"it was fell that the extent to which the {iiipil used well chosen 
adjectives would provide a significant index of the precision and 
olearneBa of his thinking ns well os a gauge of that phiibc of his vocabu- 
lary." Of course it would be hard to treat tho "well chosen adjec- 
tives" quantitatively, but the increase in the nuinbor of adjectives 
used as higher school grades nio attained might indicate that tliere 
18 a relation between mental ability and proportion of adjectives 
used. 


II 

Tho data for Iho present study weie obtained from the Junior 
division of the New Raleigh High fichool, Raleigh, North Carolina. 
Composition work of three gioups, two eighth and one high seventh 
grade, was used. Tho composition papcis weie collected at different 
intervals throughout the fiist term of the school year 1920-1030. In 
order to allow the students to have as much freedom as possible in the 
use of their vocabularies, the subject-matter for tho compositions was 
left to the writers. As a consequence, tho compositions vary widely 
in their content ns a statement of their analysis show, on p. 469 

In order to keep as close to the aim of Bpontaneity ns possible, it 
was necessary to reject some themes winch had obviously been written 

* Symoiula, P M. iin<l Baldwin Leo. iStudicH in LeaminK of ICsineBsion, Number 
III — ^Vocabulary. Tcaehors College liecord, Vol XXXI, October, 1020, p. 60. 

* O’Brien, F P. : Tho Vocabulary of High School Piipila in Wutton Composition 
Journal of Educaltonal Research, Vol 11, 1026, pp. 331-360. 
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by pupils who had resorted to loforcnco books for facts in order to 
write the paiticular theme handed in, Long lists of proper or common 
nouns wcic also oinitted. 

As a mode of proccduic tho following classifications of speech wore 
setup : (1) Nouns and pinnouns; (2) verbs and verb forms; (3) adjectives 
and adverbs (inodificrs) ; (1) conjunctions and picpositions (connec- 
tors); and (5) tho articles a, ati, and the. In order to make tho division 
of the words into diffeiont oalogoncs ns objective as possible, words 
were nasigncd to thciv division only after nbcertaining how they were 
used in the sontcnco. Hidwcll and Sicgfiied’a Handbook of Grammar* 
was used ns a guide. 

Table I — ATtiiiTiuwY Analvsis op Tiiunn lIuNDncD Twenty-bix Compo^itionb 
Whitten by Eioiity llKm Kchool Btodbnth Who VVbutj Allowed to 


Onoosu Tiikiu Own 1''oum and SiTumcT-MAT'rBu 

^ NUMDESn 

rHEMB COMPOBITION SEOUnFlD 

Descnplton--i\fii\\iVj topios of mton'Ht, (‘\poriencc8, animal lifo, personsj 
holidays, geographical looahtios 107 

C^l^^c3 — tanff, Pau-Amewenn eongroas, of Nations, eonaWnotion 

of tho (Tovonunenl, duly as citi/ons, current events of intorosfc 91 

Narrative — comploljon of sLonos, con vorsiil ions, Stoiv of Evangeline (id 

Bxposiiton — '^Ilow to Make/’ etc , ^'How to Earn Money/’ ^4to\v to 
Live at Homo,” ”Why Sliidy Laliri” 27 

Le/iers— personal, and letlnrfl of api)hcftlKm 20 

Moral into! p re tut I on of stones with moral 17 


Total S26 

Average mimber of compositions per pupil 4 075 


After the wouIb of each Bttuleivl’B composition had been classified, 
the pciccntagcH of the total nunil)oi' of woids used by an individual 
classified under tlic difTeroiiL catagoiies of the paits of speech were 
found, for each uidividunl separately In all cases all words were 
classified so that the sum of Uie percentages of the different parts 
of speech used by each individual always ainountecl to one hundred 
The table on p 470 sliows the averages and deviations of individual 
percentages of diffeient pai Is of speccli used Ai tides have the Inghcsb 
cocfhcumt of vaualnUly 

In Older that rehitioiiHliips (‘ould be found between uses of different 
parts of speech and intelligenee, cm’l.iin indices of the mental abilities of 

^Sulwelj, l^inl aiul Unssell Cr Siogfiicd' "Ilandhook of Grammar ” Charles 
Soribnei’flSoiiB, New Yoik, 1028, 
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the students whose compobUioiia weie luuilyzed had to be obtained, 
The fi?st incuaure used was the Teniuin (iroup Test of Intelhgciioe, 
Form A. Mental ages were compiilod and used througbouL the study. 

TaHI/E II — Av?}HAOb AND VAUIABlIiirV OV I’j.UOUNTAOKrt Ol.’ WoUDH WlllCIl WUBH 
OiiAaBiKii:!) uNDhu l‘'mi Divihionh of Hrnu ii ah Takkn hiom Tiiukb 
IIUNDIIKI) TwKNTY-HIX CoMPOHlTIUNH WuiTO-M )IY lOKlim UUiM SCUUOL 

iSruDr.NTH 



Aiilbiiietie mean 
of per eon Is UHeil 
by each person 

Stamlaid 

devmliofi 

Coofiieicnt of 
vaunbility^ 

Nouiir 

35 2 

2 095 

5 05 

Verbs 

23 K 

2 G24 1 

U 00 

Modifiers 

14 G 

2 3Gfi 

10 12 

Connectors 

10 7 

2 003 

11 00 

Articles 

9 5 

2 290 

21 01 


1 CocnicioHl of vuiuibjUty waa found l>v tlio formula CV — 

mean 


The ficcond mcasuie ubcd was a “Sentence Vocalnihuy Tenl/' devised 
by Garrison of Slate College, Kalcigh, aiul doHigiuul to cover a grade 


TAliliE HI. — ^AvrilAQEB AND VaUIADILITY OK MEAHimSH OP ^fl NTAL AlUTilT^ AND 
Pathhii*b OcoiJi'AnoN or Kioiity Tlnut Seiroon STtrniiNT.H 


Measures of mtelligcncc 

Aulhinolie 

meuiiH 

Shimlard 

dovuiliou 

Coeilicient 
va liability 

Mental age 

13 7r) 

1 545 ’ 

11 236 

Vocnhulary teat 

47 1)5 

0 131 

12 702 

Avoiago scliool grades 

83 10 

; 7 807 

9 305 

Father's occupation 

13 08 ! 

2 ()00 

20 5(i5 


range of from thud lo eighth ^ Foi a Ihivd cuterion, the avoiage 
grades in all thought subjects (English, limtory, civics, a natinal 
science, and language) made by pupils during the fust tciin of llie 
school year 1029 and 10!>() were obtained fioin tlie Iile in the princjiail’s 

^TIub tost m inuoh like Iho llollev V(K'al)\jlarv Sndr, but nifido moir (liHif'iiU 
An example of Iho teat ib as follmvs: To pledge ih 1o , Hcdi'r t nshion 
council promise 

A study luvolving its ubg may be found in (laiiison, K C . Tlic» Uc'latioiiship 
between Three DifTcrent Voeabulary Abilities Joiinial of lithicaiioi^cd Heacarch^ 
Jau , 1930 
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office Also for an imU'\ of home cnviioument,, the fiUhei’s occupa- 
tion was used and given a quanlif alive laling using the Bair Scale 
Rating of Occupational Hiatus ' A table of these indices on p 470. 

It was de.sirable to see what part the factor of sex played in the use 
of different part.4 of apeecli as well as the mtolligonco ratings. The 

TAniiB IV — CoMPAiHSON 01' Tiin Pnnn.NTAonH of Dii'FmmNT Pakta op Srsncit 
llflDi) itY Eicinn iriiut Sciiooi. tiini.H and Uoyh 


Number j 

Nouim 

Vciba 

Modi- 

fierH 

Con- 1 
IlliCtoiS 

1 

Al t\clc3 

30 

34 9 

21 0 

10 1 1 

16 7 

14 3 

41 

35 5 

23 7 

15 0 1 

IG H 

0 0 


following table shows lliat there i.s, on the wliolo, veiy little sex differ- 
ence in the u.se of the difleienl, parts of speech 

II may be scon by the uliove table that the chief difference is the 
boys’ and giils’ use of speech in luodilieis and aiticlcs Tlic giii.s ii.se 


Tahuj V — Comp A i( IKON or Mental Acies, VooAinrLAU^ Test Hcoues, and 

AvLH\(ilA iSoilOOL (llUI)ll IlY SlX 



Nuinliei 

j Mental ago 

Vocabiiiaiv 

libdity 

Avoiuge school 
grades 

lio3's 

31) 

M 7H j 

1 

47 5 

80 0 

Girls 

41 

14 57 1 

48 3 

80 4 


4,9 per cent nunc inodinoiH than do the hoys, while tlio girls use 5 3 
pci cent fcwoi luticleH ihan do t!\e i)oys 

Table V compares the sexes by three othci ciitoiia. Tlic menial 
ago and vocabulary index of (lie boys and girls sliow very little dilfei- 


*Iii tIuH liHfc oiin luiiHlipd ii'piPHt‘rUa(iv(* occiipfttions, oiuh ilcliiutcly ami con- 
cretely dcHcuhcd, W(‘U' laU’d fioia one lo one liuiulied }»y (.hnty judges ateoiding 
to tho grado of nilelhgciici* eauli \\\in helievTd to defHand Proliiihtc eiioi 

vaiucH woie comptUed foi all tiu'se ono Iniiiditsl o(xu|>iitioiiH and Die latings di«- 
tubuted, III the present 801(17 HioMe onaiimtiona that weie not iiududed m tlie 
ono luimlied Imted in (he Ihin iSisilo won» elassdied as tlio ncciipationa moat liko 
them Tlio Ihui Scale UaU^^^H hst is fully desc ulied ui Teiiiuin’s (Mcnelic Sludiea of 
Genius, Vol. I, p, 00 
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cncc, Tho girls outranked ilio boys l)y 4.S per cent in their average 
school grades 

By way of further analyst, niental age, vocabulaiy tests, average 
school grades and the percentages of the difTeieut pniis of speech were 
studied and zcio Older coolTicicnts were computed to show relation- 
ships among these factors. Table VI shows the various i elation- 
ships found by thia coniputatioiu 


TAUiiC VI — Tun HhiiATioN nhTWi-j.N Tiin T^ifpludnt Parts op Sriincii and 
MeNTVT* A(U;, VOC’ATIULMIY Tlst HcoUhS, and Avkhaou WcHOOTi (xRADES 


Pni ts of spcrcli 

Mental age 

Vocnbulniy 
teat Hcoro 

AvorngG school 
grades 

Articles^ 

rv 2 1 no 

48 1 00 

61 -i- 00 

Connoctorji 

20 ± 07 1 

17 ± 07 

14 i ,08 

Verbs 

- 27 J- 07 ' 

“ 17 .h 07 

- 22 ± 07 

Moclifiorh 

- 10 b 08 

- or> 1 08 

08 i 08 

Nouns 

.01) ± 08 

- . 10 ± 08 

- 00 J: 08 


* A conclftlion coofilcK'nl of 3 C ± ,07 was fouiul lo exist between Engtiah 
Grades nnd tlio per cent of arlicles iiseil 


So far ns tho sample used iu concerned, Table VI showa: 

1 The use of the articles a, an and ihCf is a bettor index to mental 
ability than is the use of any other pail of ajiecclu 

2 The use of conncclois next to articles bIiows the highest positive 
con elation with measures of mental ability, but the cocfFicicnts arc 
not liigh. 

3. Tho use of many vcibs indicates lower mental ability with low 
coefficient. 

4, Other parts of speech do not indicate miicli lelationship with 
tho eriteiia of mental ability used in the study. 


Tadle VII “-Inteucourelations DUTwr.EN THE DiKFiniENT Parts op Speech 
TJbed in Wiiri'TDN Composition uy Eiciiity Hioh Sc hood Students 


Parts of spcccli 

Artiolos 

Conncptoi’s 

Voilm 

hhalificrs 

Nouns 

Articles 

ConncctoiH 

Vorba 

MochficiB 

• 

38 1 07 

- IS J; OS 

- 40 J (JO 

40 1 no 
-- 22 1 07 
- 30 1 07 

68 J- .05 
-.Ol ± 08 
01 ± 08 
- 3(> ± 07 
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In the taW« above may bo, (ound a eUidy of il\c mien'clationa 
among the usage of diffoi cut ports of spoech. 

The study of tlie iiitercorrclutions among the different paits of 
speech suniinonzcd ui Table VII indicates the following facts con- 
cerning compositions studied: 

1 The use of a great many words of any single pait of speech, 
resulted in a less or nearly the same luimbcr of words of another part 
of speech (with tho exception of ai tides). 

2. The U.SC of articles coiiolatcs positively with the use of modifiers, 
nouns, and connectors, but negatively with verbs. 

In Older that the rdalionship between the children’s environment, 
as measured by occupation, and otiicr attributes might be studied, 
various correlation coeflicicnts between mensuvea of mental ability 
and the usage of the part.s of speech wore computed, Data me pre- 
sented in Table VIII. 


Tadub VIII — Rulatjonbiiip ni,rwj;i-N tub Use or Aiiticlkb, CoNNnorons, 
Mouiiuiihh, and run Mkntai. AiimiTy, Vocaiiwbaiiy Tcbt Sconna, AvBnAOD 
Soiiorti, CJuADiiR AND I'VrHnn'B Occupation 


Articlofl 

Cojirioo- 

tom 

ModiAcrs 

1 1 

Afciilril 

WRO 

Voonbu- 
Inry teat 

AvoraRD 

anhool 

grades 

rmber'fl 
ooau- 
^ pation 

Articles 

38 t 07 

.10 1 

07 

n2 L 00 

-18 J: (30 

01 ± 00 

32 ± 07 

Coniiaclors 

ModiOcra 

MontM ftfje 

Vocabulnry tent 

Avo Bohool erndcA 
rather '8 ocoiipntioii 


I 

07 

1!() 1 07 
^ ItJ L 07 

: 

17 J 07 
- OO i (18 

r>8 i. no 

11b 08 
08 ± 08 
27 1 07 
-41) ± 00 

02 ± 08 
05 ± 08 
21 ± 07 
30 ± 00 
01 ± 08 


The data piescnlcd in Table VIII corroboiates many otlicr studies 
that have found high mental ages associated witli high vocabulaiy 
test scoies and scliool giados. The table also indicates the following 

1 Father’s Occupation ns latod by the Barr Seale Ilaiinga of 
Occupational Btatus* previously lefcrred to, correlates po.sitivcly 
with the use of articles, which ih tho liest ineHsuic of lutclhgcnco so 
far as paits of speech aio concerned 

2 Father's Occupational llatiiigs coiiolatc po,sitively and signif- 
icantly ivitli mental age ami vocabulaiy te.st scores As hcie rated, 
father's occupation does not seem to mfluenco school guides 


' fjco footnote 1, p <171 




474 


The Journal of Edurnlionul l\\i<hnh[fii 

III 

By way of coivclusion it may 1)0 Hliitf'il (liat: 

1. It la (liflicult to cx|)lam the coiiclalion hi'twccn the meusiucsof 
mental ability iind tlie iiae of ai tides. Tlie correlation cocllicient 
between the peveentnRe of articles vised and mi'nlal aRc was 52 ± .06, 
between the perccntiiRO of art.teles mid the vocabulary lost scoie, 
.48 + .06; and between the peiceiiluRe of artudea luul avouiKO school 
gindca, ..51 ± .00. Since there is not the elianeo of using articles 
iiicoricctly that then' is with mo.st othei parts of speech, .such ns 
general modifiers, the peicentiiKi* of mlicles used makes a better index 
of nicnlnl ability. This is especially true in view of tlie fact that the 
coiiolalion cocflicieiila between nieasures of mnntnl ability and the 
use of aiticle.s nro in most cases liigher ihnn coiielation cooflioients 
between the diffciont ineasiiics of iiUMilal iibillly tlionisolvcs The 
only exception to this is the corielatioii between vocabnhiry test 
scores and mental ages, C8 ± .0.5, while the ooefhcient lietweeu mental 
ago and tho use of inlielos is .52 ± 66. 

2 The positive correlations hetweeii the use of conncclors and 
mental ability would be easier to exiilnin than thiit of articles with 
mental ability, if one assumed that the fir.st part of a sentence had to 
be kept in mind while the Inst part was Iieing composisl. The corre- 
lation cocfRcicnt between peicmdiigo of eonnectoi.s and incnlal ago 
was ,20 ± .07, between percentage of coriiieeloi'.s and vocabulary 
lest scores, 17 + .07, and between percentage of connectois and 
average school grades, ,14 ± ,08. 

3 As would bo expected in any sliuctiue, tlio jiavls of which aic 
as iiilei dcpeiuloiil and constant as tho pails of a scnlence, an incrcaso 
in the use of one part of speech will autonuitically be accompanied by 
a decrease in the use of the othci pails of speech T'lus holds true 
for nil parts of speech except arlicles. Bince articles aie so closely 
related with nouns and modifieis, positive coiielations would be 
expected between articles and these pm Is of speech, and such relation- 
ships actually exist 

4. The use of ai tides has almost as iniicli lelationsliip with occu- 
pational status as has vocabulary alulity us lepioseiitod by the vocnbii- 
laiy test scoics — tho foi incr rolatiou tieiiig lepresenled by the coireln- 
tion coefficient .39 ± .00, and tlie latter, .32 4 07 (Hiildrcn’s 
environment and possibly liorodity, ns rcpre.seiited by tlio occupational 
ratings seems to mfiucnco the mental ability ns lepresoiitofl by tlio 
mental ngc and vocabulary test scores, and at the sanio tune their 
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use of ai tides, .School Rrades arc not signiacantly influenced by 
parent’s occupation in this study. 

5 A thoioughly quaiitilativc method of moasuving the correct 
and incoircct usaRCs of diffmout parts of speech, rather than the study 
of porcenlngcs of words chiHsifled ns hoing certain parts of speech, 
would probably throw now light on the subject of the i elation between 
use of diflcient parts of speech and uioiilal ability. It is hoped that 
such a method can lie developed and u])phed. 



FALStPICA-TION OF AOIO; A FACTOR IN CHILD 
(HJIDANCK* 

anna COHEN AND NATHAN ALTUOWIT/, 

Piiychiatric Sooml Workcra, Child (iiiitliinro D('|)ttrlmptil, Ilphrcw Hlioltcring 
Ouiirdinii Society, Plonsnnlvillp, N Y, 

The wntors have recently liiul the Rood forlimo to cooperate in the 
handling of a enso involving a fttotor in child guidance which is often 
obacuicdj it is that of fivlsificiition of age, Tins apparently harmless 
act may result in inminierablc coniheta which give rnse to ahnonnnl- 
itiea in the dcvclojnnent of a personality 

Our instance is that of n boy who was committed to the institution 
as uiiniaimgcablc He is an illcgitiinale child whose mother is con- 
sidered neurotic. The hoy was hoin lu a distant city, and the putative 
father deserted almost at once. After moving to her piescnt residence, 
the mother married a man who ih a di unkard The mother repeatedly 
told the boy that ho must help her find his younger brothei ; that he 
wfls really her mainstay because of the meapucity and worlhlp,ssnos3 of 
the stepfather, Tho boy was jealous of lus brother, yet ho took a 
sorious big-brotherly intcieHt in him, lie cpuirrelcd witlr ins stepfather, 
was disobedient, and wilful. lie, was also known to steal frequently. 
Whoa he arrived at tho institution, ho contimicil to react m much tho 
same manner for a long time. In order that ho might sooner lake over 
the responsibllilres of the homo, lus inollior had made liun behove that 
ho was two years older than she thought he was She explained her 
placing him at the institution at the lower age liy saying that only by 
doing this could alio get the institution to care for him longer and so 
make it possible for her to provide at least for her younger son and 
herself. 

Thus the boy was ofHcinlly considered ns old ns bis mother supposed 
liim to be, That even this oITtcial ago was incoircct will be seen latci, 
though whether the mother iieiaclf did not know oi would not reveal 
his correct ago cannot be dclcrmineil 

His rnaladjiistmcnb at the imstitution rcaiiUed in his iioing placed 
under the care of the fMiikl GuKianco Dopuitment, Tlio workers 

'Tlio writers wisli to express Uioir apinoruUiori to Dr Is'on W Golilricli, 
Exeoutivo Dircotor; I>r timinuil 'A, OirpI, PHycliialiiHt, Miss Julia (loUlman, Ilcnil 
Psyohiatrici Worker; and Mr Myron B Binnetiard, PflycliiiilMC .Social Woikor, 
all of the institution referred to in tins paper, for thoir kind siiKRPStioiis conecrnlng 
the article 
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noticed that there wua » worried aud aomewhat reecntful look on his 
face, hiB step was lieiivy and liis head 8ngp;ed At school, he was con- 
adevod a poor Btudonl, doing liLtlo work, and coming tardy tioqacntly. 
But the social aspect of the piobk'in was even more serious He stole, 
hed, qumreled, was diHobcdient iiiul <Iid not usually miiigb or play 
with tho other children, lie exlrihiicd Rieal glea at hia firiccess in 
appropriating the possesHions of olliera without being caught, and if 
he were fcimrl out, lii‘ did not hooiti to innul. 

Since thcio wua a conlliot hotwircn the figmes foi the ago as his 
mothei had impiesscd it on him aud the age ns found inthoinslitution's 
records, the workers coinimnncated with the authorities nt his birth- 
place. It was lefti nod Hint he was even a year younger than his mother 
supposed, that is, three ycnis younger than be had come, to believe 
himself to be 

The boy was mforincd of Ins correct age, and gindually a marked 
change was noticed. He said that ho no longer felt physically inferior 
to other boys as formerly. IIis cntiio mem lias become more carefico; 
his head is held liiglior, his stej) is lightei, and he runs and plays with 
the others. He also feels that he m not retarded m school, sinco he js 
in the proper grarlo for Ins age Ilm allitudc toward scliool has 
changed; he makes it 11 point never to be lardy, takes a keen interest in 
his school woilt and m having no dilTiciiHy with it. Improvement is 
also noticeable in his social luliustincnt. lie no longer steals, nor is he 
disobedient, and he seidoin quaircls 

This description indioales lluil hcie at leiml is one cause of problems 
that can bo dealt with dnectly, (luicicly, iitiil adcciualcly. It ciupha- 
sii 50 .s tho fiigiiificanco of the iippiirpiiLly trivial inattoi of giving an 
mcoiTcct age to at lam uome special end without talcing into coii- 
eidcvation the fact that iLs total clTecl, on the peisonality may be very 
far 1 caching. 

Yet how often, for example, do the paicnls, misleading the mithoii- 
ties, stmt the child m school lioioie lie has reached the propei age'^ 
The causes of falsifiealion of a chihl'.s age vaty Those who are 
responsible for huch an act aie gonerully inoliivalcd by one or more of 
several dcfiiiile factois 

Tho molliei may have no time io ciuc for Iho child, she may liavci 
to go out to eaiii a living, or she may liave 11 vounger cliild to take caie 
of. On tho other liaiid, l.lie child may have been unwiniLeil He may 
be an illegiUmalc child, whose illogilimiicy will not lie suspected after 
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tho ago has boon falsifioil Oneo this is ^lono, ihcMo <lovrlop problems 
that ai’c difriGulfc of HokuUm. 

First of all, tho elnUl m foiood into Hiluutioim lluit lin is too young 
to meet Imagine the diseoin aging ami iisnciah/Jiig elT(*ct of constant 
defeat in athletics in eointxMiliori with nuirh bigger lioys of his pur- 
ported ag(5. It luillH Min ebild'h play life and (cikIh iu make him 
scclusive 

Second, it inquires Mmt dm child live up to t \vn divergent standards 
of bcliavior, one at home and one at sehooh Ho theie develops hi his 
mmd a conflict as to which one lie is expected to uphold. 

Third, ]t nuses the child fioin one soeial nlatUH to another without 
adcciuatc prepavatiou, At the Uuio wlieu he aUovild ho looking 
foiward to coiiqiloting liiK education, li(' m placed in Mm position of 
breaclwiiinei, The child lliorofore feoln deep concern over his failure 
to gam the iiaining nccessaiy to make linn capable of slmuldering these 
responsibilitios 

Tho coiribinod effect of all these factors, nnjiressed upon the glowing 
child may eventually turn him into a senouH piolilmn, 

Tho soliiUon of the difliciilty must necesHanly lie in the letiivn of 
the child into the family situation at Ins eonecl age wiUi I he slandaids 
suilal)lo for that ago, 

Noi’W — Hiuco the purpose of this paper m to ]>resent the. problem of 
age falsification per no attempt lias been made to give' tlie analytical 
iiitorprctalions that would be involved in coniiik'liug the iiicUire of the 
case 



new publications in educational 

PSYCHOLOGY AND RELATED FIELDS OF 
EDUCATION 

CONDUCTION IlY FUANCES M POSTER 
— — — J 

Adolescenl Educnlion, by Eiwlciuik J'l. HoRou. New Yoik: The 

Macnulliui Company, 1931. Pp. 5()G. 

It IS perhaps no ion lo say that Ihoio is no other field of 

education conoainiiig which nioic HCiontific knowlcclKO w needed, and 
less IS availnlile, than m the hold of adolescent education. There has 
been a dearth of hcieutdic U(ci!Vt.«re. produced in Ihia hold during the 
past fifteen ycai.s 

"Adolescent Itdu cation" 5>y PiofeK.sor Frodoiick H Bolton will 
meet a long felt need in tins pailicular field. The educational world 
apparently has not fully it«eov<«ted fioin the km sustained by tho 
depniiuio of (tint i (‘markable student, t<*iu‘h(*i’ and educator to wlio&o 
memory Profe.ssoi Bolton lias dedicated tins book. 

The authoi btati's that, the book is intended to bo an analysis and 
inventory of the adolescent for the purpose of rinding his potentialities 
and his needs as dolerniined liy bis nnfohlinenl Tho courso of study 
IS treated only inci(lenliilly and only as n means to an end The 
author tells us that biihiiK'ss, social and economic conditions and 
traditions have been tlio (Mliieiilioiml doleiininanta, niul that the edu- 
cational theorist, not triuiied in imyehokigienl aniilysw proceeds with 
what ho conceives to he (he logietil unfold inent of the. subjects and 
arrange.s the Iraditioiuil sohool subjects info what ho conceives to bo 
ideal "ineiital dihcipline " 

The ehild psychologist, insleiid of seeming his basic information 
from industiK's and I he woild at huge, endeavors to secuio lus infor- 
mation directly fiom the childien 'I’his pioecduic consists, perhaps 
finst of all, of a tlioiougb seienlific amilysi.s of the child's physical 
equipment, aceompumed by .i (hoKUigh and scieutdic annlysiH of hia 
instinctive (oiideiicie.s, In.s monfid e(inipnien(, and hi.s iiiteresla all of 
which servo as a key lo lh<‘ kinds of activity bcssl smteil to tlic pioper 
dcvelopnu'iit of the eliild 

Piofcs.sor BoKoii points niil, (he often unolisoived fact that a scien- 
tific educational piocediiio bmld.s upon whut is, in oidei to achieve 
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what is io be. This nccesHltatcs a Hcicntific aiul funclionnl knowledge 
of tho pre-aclolesccnt, ndoh'scciit tuul tiu} post-adolescent life of the 
child Professor Bolton's book consists of sKteen cluiptcis each giving 
a scientific treatment of a fundamental aspect of iidolusconl education, 
Tho book reveals a innstery of tlio scientiile Id Mature iii its field Bach 
chapter is accompanied by a ciuefully Hclcclod bibliography. The 
book concludes with a tlioiougli and cnlightcniiig tronlniont of the ever 
present and gigantic problem of (lliai actor iMliicafkon. 

Dknnmh (1. TuoTii. 

Pennsylvania Hlato College. 

A COllRECniON 

Editor, Thu JounNAu op Edocationai. PHVCfioLOOY. 

Beai Sir; 

Theic is an ciror (of transcription) in my foimula in the aiticle, 
"Tlio Sigmns of Combined DlBlulnition.s (’nlciilated fiom Sigmas, 
Means, and Frequencies of (*omponenL Distnliulions,’' in the April 
issue of Tun Jowmnal. In Formula 7, page 310, tlio second term of the 
left-hand moinbcr rcpicscnting the combined moan Blioiild be squared 
This error was discovered by Doctor Louis \Y. Gollcnnann, I am 
also indebted to Doctor Harry IIcIhoii for reporting difficulty with the 
formula as it was printed. 

Tho correct form of the formula is‘ 

{aj + + W + + . W d- 

iV, + Aj+ ■■ An 

f%)Nx + 

Al-bA5+ , An 


Vale University 


C. 11 Garviy. 



THE JOURNAL OF 

Educational Psychology 


Volurao XXII Oclolicr, 1931 Number 7 

ONE MOllE STUDY OF I’EllMANICNCE OF INTEREST* 
HAIIVEY C LEHMAN 
Ohio UiHvoisily 

AND 

HAUL A. wrri'Y 
Norlhwoalcrtt University 

Tho question of pei iniuu'neo of vocational interest is obviously of 
utmost imporliinco to those concerned with problems of personnel 
and guidance. If guidance bo based upon a iiuiiil’s iissumod occu- 
pational intovcst, and if this assuiued interest proves subsequently to 
have been merely a passing fancy or a lempoiary whim, the outcome 
of course will bo wasteful un<l the practice injudicious. Obviously the 
question of tho degicc of pernianeiic(‘ of iiitcrcst i.s one of great 
individual and social sigmlienncc. 

In order to ascertain the extimt and degree of pcrmaucnco of 
vocational interest, tho wiiteis adinimstoied the Ixihman Vocational 
Attitude Quiz to a Inigo numbor of school childicn m Topeka, Kansas, 
and in Kansas City, Missouii t 

The Vocational Attitude (iuiz consists of a coinpiehensivc and 
catholic list of two liundiod oecu|)ation.s. Fust, the childicn arc 
asked to check only those oecupalions in which they are willing to 
engage as life woik. They aie then asked to indicate. (1) The three 
occupations which they would like heat to follow, (2) tho one occupa- 
tion which they most likely will follow, (.’1) the three occupations which 

* Tlio present Btwily pre.Honta Hoinn limlmnH Unit tnwo bmi mnilo poanbln by a 
grnnt'in-nid from Llin Kocint .Si'ioiice Itcsciin li ('oimni 

t Tho wnlnrfl tiro iiulobltvl to Mitw Annii (f Myers, Mr. J F Knho, fiiipcriii- 
tendent A. J fitovit, himI Kujicrinlendeut tleoigo A Melchor for imsiataaco in 
securing tlicso datn. 
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they think lire the licst inom'y-innkcrH, (1) the tluce occupations 
wbioli they believe are moat icapected, iiiitl (5) llie Lliiee occupations 
which they hclievc will require the least iinioiint of effort 'fhe 
iiumboi of childicn fiom whom dulti weie obtiiiiiecl ik indicated m 
Table I. 


TahLE I — TOTAt NuMIIKU of ('llll,l»n»,h Im I.UIIFI* in a .Si IIII.H ok iNVtbTIOATlONB 
OF CntM)ltI'N'H VfK'ATIONAI. AmTlIDI-H 



Topoka, 

Toppka, 
May, 1928 

KanK4iH ('ilyi 
Novciiibor, 

KnuHftH C’lLy, 
Novonibor, 

KanHGS Cily, 
November, 

Ages 

0 dob or, 
1927 

1928 (*iupo- 
riorreonom- 
ip HlaUiK) 

1928 (inff'rior 
rconoinic 
HlatUh) 

1028 (aver- 
age cconomie 
ataiuB) 


Boys 

(brh 

Hoys 

CbrlH 

IlOJH I 

(brlH 

Hojfl 

(bilH 

hoys 

Girla 

m 

203 

259 

82 

101 

137 

180 

140 

J74 

304 

324 


340 

3D8 

267 

274 

212 

211 

182 

203 

342 

369 

loH 

403 

372 

347 

340 

2(U 

2:38 

230 

222 

•130 

436 

IIH 

387 

376 

386 

365 

250 

272 

253 

228 

36G 

377 

m 

392 

372 

420 

337 

331 

320 

2r>0 

250 

313 

332 


305 

345 

303 

378 

373 

317 

236 

222 

262 

298 

uVi 

301 

301 

362 

320 

291 

346 

100 

104 

240 

282 

16)4 

324 

322 

286 

343 

294 

306 

132 

181 

200 

241 

m 

2C1 

200 

230 

201 

248 

217 

03 

05 

172 

197 

17H 

102 

160 

100 

171 

132 

111 

40 

37 

100 

06 

1814 

67 

30 

00 

44 

48 

33 

13 

7 

43 

19 

Totals 

3264 

3280 

2008 

2933 

2680 

2666 

1706 

1709 

2773 

2969 


Total boys 13,340 

Total eirla 13,1)32 


Gtancl total 20,878 


Table II prescuts the ordci of merit (iniik frequency) of occupations 
in which boys 8)^ to 18)-^ years of ago stated that they would be willing 
to engage. Table III picsents the lank of occupalions liked best oi 
preferred most by the boys to 18)-^ years of age. 

Table 11 is to be rend ns follows: ''Aviator*’ is the one occupation 
that was moat frequently checked by hoys of 11).^ to years of 
age as the occupation in which they would ho willing to engage ns n 
life work, This activity ranked sixth for boys 8j.^, tliird for the boys 
9^ years of ago, and second for the boys of 10).^ years of ago. A blank 


Permanence of Intel est 


483 


space m the table indicates that the pailicular occupation was men- 
tioned by an excceduiRly small percentage of pupils, and a rank 
tlierefoic was not asaiRiied Tables II and III show the lank only of 
the most frequently mentioned occupations for each age group 


Taiilb II — Uank m Fin mmNOV ok ()tcui>\TioNH in Wiiioii Hoys os' SI 4 to 18^ 
Ykauh op Aon Woiu.d Hk \Vim,ino to liNoAori 









Agra 





No 

Occupatiima 

J 

1 












H'ijoVj 

10* i 

u;y 


13»!J 

lUs 

i&H 

;10>^ 


18>5 

00 

AvialoT 

1 

0 

1 

n 

1 

1 

1 

1 

1 

1 

1 

1 


Q\s\\ oiiRinm 


2H 

iSu 

IH 

10 

5 

1 ^ ' 

1 

1 a 

1 < 

2 

18 

ilroliilcofc 




38 

27 

10 ; 

7 

4 

3 

1 3 

3 

83 

Elcclncifin or clcrlricnl pORiticor 



J7 

28 

18 

12 

1 0 

3 

4 

2 

4 

100 

Co^sboy 

1 

1 

1 

2 

2 

2 

11 

33 

35 



30 

Sailor 

2 

5 

:i 

5 

7 

15 

21 

2Q 

38 



33 

Army oflircr 

J 

2 

0 

4 

5 

8 

17 

15 

15 

18 

13 

M 

Soldier 

1 

: *1 

4 

1 

11 

1 22 

30 





110 

ShcrilT or polironmii 

5 

7 

10 

12 

23 

1 31 






70 

Profmionfll limcbnll plai cr 

7 

0 

fl 

! 3 

3 

! 1 

5 

11 

11 

12 

20 

07 

Jookoy or AMloinobilo ractr 

H 

H 

s 

1 7 

8 

13 

14 

18 

10 

26 

27 

^2 

Ship builder 

U 

11 


: 23 

33 







74 

Fironmn or cr^inccr on » trnin 

10 

0 

1 0 

10 

13 

H 

10 

15 

20 

31 


102 

Fj|hcr/aan» huiUcr» or 

11 

11 

1 

1 13 

10 

IH 

15 

23 

20 

20 


70 

Firomai (nnAwcrinK lire nlfiniifl) 

12 

12 

10 

23 

31 







0 

Banker 

, 11 

13 

li 

17 

17 

. 11 

12 

7 

0 

7 

8 

35 

Naval ofllrcr 

n 

10 

7 

0 

0 

0 

U 

8 

10 

11 

: 10 

3 

Lawyer 

15 

IH 

21 

21 

21 

20 

18 

12 

8 

5 

5 

00 

Profcaflionnl^hoxcr or wrrnllor 

1 10 

10 

15 

10 

20 

21 

26 ' 

31 

80 



08 

Phyaicfil dirertor or ftthlello roiipb 

1 


4U 

33 

20 

27 

20 ' 

20 

17 

18 

0 

52 I 

Muaicjnn 

, 31) 

43 

33 

27 

20 

23 

10 

10 

24 

17 

8 

05 1 

Kftdio expert 

20 

21 

23 

22 

Ml 

to 

10 

0 

ll 

8 

0 

20 

Aulomebllo doalor 

21 

17 

2tl 

21 

2ft 

30 

28 

2B 

21 

18 

10 

103 

Explorer 

' 

31 

20 

MI 

10 

17 

13 

; 

0 

0 

0 

107 

Forest rnoRcr or woodHmaii 

42 

25 

13 

14 

12 

7 

4 

0 1 

6 

0 

11 

108 

Dctcclivo or accrct aerviro work 

31 

^2 

12 

8 

1 

3 

2 

5 

7 

7 

16 

01 

Skookraiaer or ranclmmn 

20 

11 

i 

11 

11 

0 

8 

u \ 

13 

20 

10 

80 

ChemiBb or chotnicnl 





32 

24 

20 

17 

10 

13 

10 

10 

Buyer for a largo atom 






28 

33 

21 

12 

15 

7 

130 

Confectioner 

IK 

)3 

11 









loo 

Night watchman 

17 

t 

20 

13 










Those of equal fr('(|ucncy are given the siiine iiink but, contiaiy to the 
usual custom, lanlcH me oniilted in instunces in which few or no boys 
checked the occupation 

Certain of the frequency ranlcH change inaikoilly with advance in 
chronological age. Foi exiunple, m 'J'nhlc II the tliiid item from the 
top of the hat is "Architect,” T'liis oecupulion was laicly checked 
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by young cluklipii, but ul agc'.s 10* -j to IHJ i, it waa cliockocl frequently 
and thcicforo iccc'ivcd rank llircf* 

In Tablo III, llio second ilcin ih ‘‘(’owljoy’' Tina occupation 
receives rank one at iigt’S ninl 03 i* At the upjji'r age levels of 
course this occupation ranks very low, 'I'he rin(lmg.s for tins occupa- 


Tath.h III —Hank isi Fnv.uwBNi'v ok OnatvA'noNti I.ikkii lU,ttr nv Uoks ok 8}^ 

TO lai'i Yiahh ok Aob 


N^o 

OcQuptkUons 


1 

1 

1 



1 




1 

OO 

Avifttor 

y 

2 

1 

1 

1 

1 

1 

1 

1 

1 

1 

lOO 

Cowboy 


1 

2 


2 

fl 

10 





a 

Lawyer 

0 

7 

lU 

0 

7 

0 

10 

6 

1 

2 

3 

8i 

Civil engineer 


10 

fl 

11 

3 

2 

2 

2 

3 

a 

7 

2 
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i9t) 

n 

13 

10 

11 

11 

11 

U 

7 

0 

0 

0 

Sd 

Army omccr 

i 

J 

3 

4 

0 

Ifl 

24 

12 

21 

13 

8 

70 

Vroicaaionnl bnoebaU plti> cr 

0 

0 

fl 

n 

4 

i 

fl 

tt 

10 

12 

11 

0 

Hanker 

7 

0 

IJ 

in 

U 

13 

13 

0 

7 

10 

10 

03 

Musician 

20 

lA 

11 

10 

10 

12 

7 

8 

0 

G 

6 

T1& 

Naval oDiccr 

12 

10 

0 

5 

0 

13 

14 

Ifl 

18 

16 

ID 

S3 

Elooincian or oicctrioal criRinet^r 



20 

22 

5 

3 

3 

3 

2 

4 

4 

la 

ArcUiUct 





IT 

10 

L 

4 


fl 

2 

08 

Phyalenl ilircotor iir alhlctifi roacli 






21 

23 

12 

11 

11 

4 


Mnvjo nulor 

17 

11 

18 

18 

in 

in 

10 

13 

10 

10 

13 

n 

Fironmn or engineer on a tr«in 

8 

7 

7 

7 

0 

7 

0 

17 

12 



31 

Botdlcr 

3 

4 

4 

12 

20 

30 






no 

micnfC or ])olicomnn , 

lU 

11 

15 









30 

Sailor . , 

6 

n 

0 

8 

in 

21 

20 





07 

Jookoy or nutomobllo rncer 

13 

8 

0 

13 

13 

17 






108 

Dotceltvo or eocrcL service work 


, 

13 

10 

H 

0 

8 

11 

11 

15 


U 

Nouapaper work 



, 


, 


25 

I« 

14 

14 

7 

107 

Forest ranger or wouilemaii 



20 

10 

13 

8 

0 

10 

8 

17 

13 

05 

Hadlo expert 





23 

23 

16 

10 

10 

21 

11 

OQ 

Fftrmcr^ miarcUftticouii , » ^ 


IQ 

17 

20 

10 

18 

10 





01 

fltockraifier or rniichnian . , 



10 

14 

12 

11 

12 

14 

11 



00 

ProfcBaionnl boxer or wrceller 



10 

17 

22 

25 

30 
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Mcehaciicnl cuRUveot 








, 


7 


fiO 

Clieinist or ohemloal engineer 
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tion are portrayed clearly in Fig 1 and Tnlilc IV winch present the 
percentage of live gioups of wluto boys of various agi's who iissortecl 
that they would bo willing to bccoino cowboys. It will bo noted from 
Fig. 1 and Table IV that the ranks aio lelatively consiHlent at the 
several early ago levels. Nevertheless, it is clear also that pcmianencc 
of interest in this particular vocation is decidedly lacking. 
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The wiitcrs have n^iseinbled, Hiimliiily, data for all the occupations 
of the check-list wliich weie leportc'd liy the children as ones which 
they would be williiiR to enter At .‘iRe the average number 
checked by the boys was ‘iS.lt; at age 18). 2, the average was 15.6. 
Since tlie number of occii pal ions in winch boys may engage is exceed- 
ingly largo, tlic percentages for each of the many occupations are 



Fia 1. — Por coiitu of Hvo of whito boyn of vanoiift ngo IqvoIb who exproflaod 

\s jlhn«tir8fi lo heromo ^‘(Jowhoya '* 

I Topokfi, Oct , 1027 

Topoko^ Mity» 11)28 

I QGOixQTutc Btdtua) 

ICiuimiH Chty, Mo , Nov , 1028 (Inferior ocotiomia atatus) 

— KariBOH City, Mo, No^., 1028 (Avorngo oconomio atfituB) 

small. Because of this fad, llie dal a showing percentages foi each 
age level do not portray vividly the sti iking ehanges m attitudes that 
really lake place fioin yi'iii hi year. A cmefiil study of the data, 
suggests liowever lliat perinaiK'nre of interest does not exist in many 
or even most of the voealional pieferenees of boys Indeed, from 
examination of the ranks of the oceupalions at diffeiont age levels, 
the writers have been foiceil to eonolvule t hat pci Imps no phase of 
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human naturo ]s Bubjcct lo mirh marked clumgf an lhal rellectcd in the 
vocational mterebts aiul profei eneea ot RrowiiiR Imya. 'I'lns conclusion 
diiTera strikingly fioiii tlmt exprehsed by ininiejonH woikers of tho 
past and by sovciul prebcnt-day onen 

Among the carhent stiidk’S nf peimaneiu'e of inlercst were those 
of Thorndike.* Thorndike concluded lliat it would lie hmd to find 
"any feature of a human being wliicli wns a imicb morn perinanent 
fad of lu3 nature Ihun lim lelnlive degreea of inleieHt in different 
lines of Ihovigbt and action " (1* 4f»fi)‘ lie concluded also that 


TaOI.B IV.— PUnCKNTAOB OV FIVB (iUOWl-H OF WlIHE UoVB OF Vaiuous Aob 
Levri/B Who ExvuKftH»»> to UKroMB 
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0 
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7 
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mtcresb and ability arc so closely bound together that '^either may be 
used as a symptom ot the other almost as well as for itself/* (Pv 456 
Several writers interpreted Thorndiko's conclusions as implying 
that children's vocational ambitions are relatively permanent and 
that vocational ambition is a suitable index of vocational ability 
In 1922^ Frcyd wrote icgarding Thonuhko'a woik: '*Tho mothocla used 
were such as to make TCBults of limited signiRcunce yot in thoir field 
these results are practically all that are available ” (P. 244.)^ 

Several writers seem to regard Thorndiko'H former pronouncoinenlsand 
the subsequent generalizations of other writcis an valid when they nic 
applied to children today. Moreover, theie are many attempts to 
verify tlio basic theses Books and articles are now being published 
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which present cvi<lc‘nco of a conUmuince of intor(\sts for a few months or 
a single year an proof lliat huch alleged vocalioiml interests are sympto- 
matic of permanent mieicHlH I'ninklin reports data obtained fiom 
some fifteen hundrcMl juiuoi high Mshool pupih of nalUmoio who weie 
asked in Dcccnibei, 1U22 to munc‘ llie occupation tluit they would like 
best to enter Follow-up fiiK^slioiumneH weic filled out in May, 1923, 
OcLobei, 1923, and Derruiilier, 1023, The following eonclusions wore 
expressed 

Tho votaCioiuil iiiloieHts of junior high hHiooI pupils hIiow <i vory high degreo 
of permanence over a peiiod of nt least one year, — niid that a very critical one 
Two children out of every Ihiee luwo tho munu preferciico at the end of the period 
as tlioy had at the beginning (P 156 )» 

McCracken and Lixiwh loport a senes of BtudiCB that were made in 
Denver March 1 , 1920 , May 25 , 1920 , and in Apiil, 1921 . The 
problem of peimanenco nf inlcMeHt was btudiod foi a ponod less than 
three months tn length. 

Of 4181 junior and Mnimr liigh-Kehool Btudeiits ulioso clioiccs were recorded 
for March 1, 1020, and Nfay 26, 1020, willi the intervening time nearly three 
months, 73,9 per eeiit of llie hoyw and 70 5 per cent of tho girls chose tlio same 
occupation on both orcasioiiH * 

The cieduloiiH veivdor m mfonnetl tbal ^‘ThcHo chuiccB, although 
mcido so cloBc togidJu'r, do indicate feomo permanency ** (P 43.)^ 

It will be of inl<‘ioHt at tliiH |)oint to oxainlno Fig, L If tho lines 
of this graph lopresent the Hitiiafrioii aw it will pxmt fioni year to yeai 
it may be asBcrU'd that a V(Ty largi* peicenlugc of the boys of a given 
age wlio are willing to become cowboys will continue to cling to this 
notion three months hence,- - oi even a year hence. To this extent, 
these data conolmrate those of Fianklin, and those of McCracken and 
Lamb. It is clear, liowovor, that oier a longo j)G) lod of izme, a pei- 
mancncc of iuloroat would noli 1)0 found It Lheicforc seems invalid 
to base conclustoiiH regarding poimaneiice of vocational intcicst upon 
a study Umt conlinuos only foi a few inonlhs oi foi a yeiu 

The writciH have utlaeluul the problem of pcriiumencc of interest 
in a somewluit diffeiont mannoi 'I'lii'y liuve sUitliod the vocational 
mtorests of sevoiul thouHand cluldien of ages to 18H- "fhe 
writers are lieie assuniing lliat llii‘ piewuit 8* ^-yeiu-old cluldien would 
lespond next yiMir as do tlu' 9 ^ 2 -y^‘ni-old ones, etc Tho validity of 
this nssum])ti07i they mo nt (lie pn^.seiit lime invesligalmg Scveiiil 
follow-up studios are nn(h‘r way lo test tlin reliability of the children's 
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reports. Nevertheless, it Bperas loKical to lussuinc Llmt groups of 
cliildren will respond next year as do cluUlron now 0^ 
years old provided that the children live in n conservalivo city, not 
affected appreciably by a Hhiriuig popnlution If the wiitten expres- 
sion of willingness (and intention) to enter a given voeatioii be regarded 
as expression of interest, it is obvious tlml iniuiy of th(‘ intciests of tlio 
ohildrcn heroin studied catinol lie regaidcd as peniiiiiu'nt since many 



11{5 14it 15?t 16^ se.cf. 


Fia. 2, — Por con Is of five groups of hoya who alnlcd tlml they expected to on tor ono 
of Iho following typea of oiiginoorlngt^ohomicAl, oivil, oleclncnh incchnnionl, or mining 


interests of tho chiklicn change inaikodly dining a pencil of several 
yoars, 

It will bo of interest to cxiuiiinc the hypothesiH that interests are 
symptomatic of ability. Ability is sonietiines conceived as inherent 
capacity; inboin and unchangeable,. It Huh coneejit bo adlicred to, 
the hypothesis that interests arc symptomatic of ahilily poslulatcs the 
additional hypothcBis that inloro.sis do not change inarkedly The 
data herein presented reveal tliat certain of llio childicii's interests 
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change markedly cluriiiK a period of scveinl years If ability be 
conceived as inborn and rircdetfriiuiied, it is clear that the children’s 
mteiesLa can not be conHiderod leliuble indices of tlioir abilities 

Figuio 2 sliows the percentage of the five groups of boys who 
stated that they exptUed to enter one of the following forms of 
engineering. Clieinicid, civil, eleclrical, iiiechanical, and mining. The 
United States cenaus report allows that in 1920 these five groups of 
engineers included only 1 lib, 789 while persons. According to Iho 
census report there were, in the United Slntesin 1920, 29,053,677 white 
males of ton years of age and above who were gainfully employed. 
Of this number the five engineering gioups listed above comprised 
less than onc-linlf of one |)er cent (0 10 pei cent) If the latio between 
the number of eugineerH and the total number of other gainfully 
employed while nmle.s coiUinue.s to remain similar to the 1920 condi- 
tion, it IS clear that no ng(“ group can conlributo many members to the 
five engineering groups previoualy incnlionod. Figure 2 shows 
that 26.6 per cent of tin* 17*^-yeur-old boys slate that they expect to 
enter engtneenny. Of eoursi* one iiiusL boar m mind that many of the 
less compelenl boys have been elnniiialed from school by the time 
ago 11)4, is reached It is also well to boar in nuud that these are 
city boys having unusual educational lulvantages. After duo allow- 
ance has been made for sueb fuels a.s these, one can scarcely conceive 
of the demand for engmeers inci (‘using anniciently to absorb so many 
youthful aapirnnls 

The Vocational AtliLudi* (iuiz meludcd forty professional endeav- 
ors. Figure 3 pre,senlH tlui pmconlago of the five groups of boys who 
staled that they expected to enlo these forty professions The per- 
centage varie.s fiom 21 to 50 at the various ages. According to the 
U. S. census loporl, these foity pi ofe.ssioiis included in 1920 only 3,16 
per cent of the total nuiiibei of wlnle males of age ten and above who 
were gainfully employed. Theic' is of coui.se no valid reason for 
behoving that the 1920 ratio is to exist indefinitely. On the other 
hand, it is impossible to believe that over fifty per cent of the 143^- 
ycar-old boys will have tlic oiipoi tunily to enli'r the professions It is 
more likely tliivt only a Hinall proporlum of these boys will be ablo to 
find a place in the profeasions and a slill Hiiialler proportion will enter 
upon the pailicular piofession which at age 1 limy expc'cL to eiitci. 

The situation for I lie gnis of vai ions ag(' levels who staled that they 
expected to become stenoyrdpherH in lypi'^h is siinilai to that of tlie boys. 
Figure 4 shows that ov(‘i thirty pi'r eent of live IKt-j-ycar-old girls 
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oxprosBod tins vocalional tloairo. 'J'lic U. S. consUH ro|)ort bIiowb that 
in 1920 the will to fornaio stcnograplw'r.i an<l lypistH (.'502,004) included 
only 0 8 per cent of the white foiniilo workci'B (6,002,210) of ages ten 
and above. 

As a pioneer lu the field of vocational and educational guidance, 
Thorndike is entitled to the respect, of all Ni'vertheloss, Thorndike 
would insist, the wrilor.s believe, that Ida data and conclusions be 



Ages- Qt 9jf 10 i Hi 12i 13i Mi 15i i7i 10ii 

?4)C 35% 40% 45J5 50% 40% 48% 40% 48% 

Fia- 3. — Por conta of flvo groupe of hoys who nlalcc) that thoy oxpootGcl to ontorono 

ot forty pTofcRftiona 

verified. Certainly, in a country in which social attitudes and values 
are subject to such reactionary and sporadic fluctuation, it is essential 
that behavior data be assomblcd repeatedly to show important trends 
and socially significant changes. It is, however, diirioult for us to 
modify attitudes which have been generally accepted. Striking indeed 
is the domination of outgrown, impotent, and socially undesirable 
determiners of conduct. 

The obstacles to psychological advance include not only factors 
such as inadequate methodology, social taboo, etc Psychology is 
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held back also hy a wmIouh fucloi which is not frequently menlioned. 
Once an enoi has cHJpt into psycholoKieal lileraturo, ifc often requires 
the labor of Hcvorfll Renorivlions to modify or to dislodRe it. At some 
future date it will he of interest to students of psyclioloRy to trace 
numerous Roiicrally accepted pieseiit-day misconceptions and rational- 
izations At Uuil time it is hif'lily probable that many of the 
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Fio 4, — Per coritfl of fivo RroupH of kifIb wlio Blntofl that they oxpoctod to bocomo 

,8toiinRrA[)lierH or iyiiiats. 


studies of peijuanonce of vocalional intciosl will bo cilod as splendid 
examples of ilio iniidoqiuioy of ttio roCiospeciive mcLhod for identifying 
interest 

The data asHoinblcM! by tlio wriUMH imlioiito tliat ei'ilam vocational 
mteicsta cannot be perinaiKnil, (Hce Figs 2, .1, and d ) Other 
intoicats may bo inoio pfannuu'iit, And aviiilaldo <lata show quite 
clearly that intoroslH ur(^ Hyinptoinatic of ability only to a hiniled 
degree 
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mieror reading as a method of analyzing 

FACTORS INVOLVED IN WORD rEECEPTION* 


Mn.ES A TINKER AND FLORENCE L CJOODENOUGH 
llnivcrflitv of Mitim-Hoiii 

This aliuly whh uncloilakoii fin the puiposo of nsccrlainmg to -what 
extent the natuic nnil fn'inicncy of tlio onois made in learning to road 
aloud English prone iiialcrial ui Ihc rovcvHcd position as shown in a 
mirror iniglit Lliiow liglvt upon tlie poiceptual pioccssos of ordinary 
reading Four adult subjeolH, oiio man and three women, none of 
whom liad had previous formal experience with minor reading, 
participated in the nxpnriiuont. The subjects worked in pairs, one 
reading aloud while the oilier acted as iccordcr and timekeeper A 
rcotangulnr mirror eight by ten inches was used, In the initial 
stages of the cxporiini'iit the minor was held in an upiight position by 
the recorder; but as Ihis was found to lie homowhat inconveniont for 
both persons, a support was devised which hold the mirror at a constant 
angle of one-huiidiod degrees with the lop of the table. Each reader 
held the l;nok liiinHclf and ndpisled Us dislnncc from the mirror accord- 
ing to Ins own prcfeioneo. 

In taking the record, tlie recorder occupied a position facing the 
reader who licld t)ie Iwok wilJi il» back towards himself and llie pages 
facing both the minor and the leeoidoi . In this way the subject was 
able to lead from the iniiror, while the iccoidcr followed the text 
directly and made nolo of oaeli eiior n.s it occuiicd A prepared foira 
was used for this purpose, At the ond of ten miimic.s, which was timed 
with a slop watch, the Kignal lo .stop was given and a rccoid was made 
of the total numiKM of woida leiul and the number of errors 
made This included iirrois whicli were spontaneously corrected 
by the subject as well as Ihose winch passed unnoticed or at least 
without collection. 

Reading was carried on for ten miiuiLes daily dining the period from 
April 4"July 31. At tins lime the Hummci vacation intervened, and 
practice was suspciidod until Hopli'iulici 2r> when it was again resumed 
and continued until Novemlier I Kave for occasional unavoidable 
omissions, piacticc took place seven days a week during those periods 

* Qrfltoful ackiimvli'ilgiiieiit in due l» Di Mary iSJurloy wJio sorved bb siibjcivt 
througlioul the experiment, iiiul to Mis Eva Tinker who not only noted na subject 
but is alao icaponsiblo for llui work of tubulating the rctulla 
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There was some variation m tiio tunc of day ut wlucli the reading was 
done, but ns a rule it was earned out duriiiK llic early part of the 
evening. 

The reading malcniil used during tlie spring and summer included 
two detective stones and one novel,* During llie fall, approximately 
half of “Paycliology, Its Facts and i’rincjplc.s/' by II. L. Ilollingwortli, 
was read. The last type of niateriui was better suited to our purpose 
Ilian were tliceiu'liei .seleclions, Iieeause of its gienter uniformity from 
page to page. It is piobublc that of the inegulunty in the clmiaoter 
of the fiction inntennl vised for the first purl of live expeninont, with its 
frequent cfmuge.s fioin conveisation to desciiplivo matter, accounts 
at least in pai t for the irregularity of progress in the early portion of the 
learning. 

Marked individual diffcreneo.s existed among the four subjects in 
the ability to adapt tlieinselves to the reversed linage in mirror reading, 
and these diffcronces mcronsed riillier tliau deci eased with prac- 
tice, All four Buhjeels .showed rapid unproveinent during the early 
Bliiges of the learning and very .slow gain Ihercafler 'I'hoio i.s a distinct 
lapse in cflicicncy upon taking up eaeli new hook. Tins difference is to 
be attributed ohieily to the large iiiinilier of new words which were 
encountered within the early stages of lending a new hook, rather than 
to a change in the typography The size and style of type was very 
similar for tlic four books 

For the entire cxpcntnenlal period the mean uuinhcr of woulsiead 
per error Avas as follows; For Suliject No 1, ld8, Subject No. 2, 347, 
Subject No. 3, ]63; and Subject No. 4, 141. With the exception of 
Subject No. 2, there is bvit small diffevcnce in accuracy among the 
four readers 

Whilo the foicgoing results have some niloicst for the general 
subject of learning, the main intorcsl has to do with the iiatiu’e, fre- 
quency and position of the enois made, and the relationship of these 


• In order of rcndini;, tho books mhoiI woipi 

1. Gluck, S "Tho Green Klot," 

2. Jordan, B, Cl.: "Tlio Bluo Circle ’’ 

3 Vanco, L, J.. " White Fiio " 

4 IlollingworUi, II L,: "PayolioloBy Its Facia ami Pruieiplos ’’ 

The first and third woio read completely by all four subjects Subjects 
No 2 and No. 3 read about half ol tKo second book, then auiialiVnted “The Closed 
Book" by J. E Meyor, Approximately half of tins was read SiibjcoLs No 1 
and No 4 completed tho second book without substiliilion 
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factors to word-porcopLiou. A. summary of the experimental findings 
to date* reveals some lack of agreement as to the relative importance 
for perception of total word-form and of the separate elements or 
letters of which a word is composed, or in other words, whether words 
arc commonly apprehended as configurational wholes or by successive 
perception of their hcpaiate parts or letters. The consensus of opinion, 
however, seems to bo in favor of the former hypothesis The experi- 
mental finding of Cnltell,' Mossmer,*’ Goklschcidci and Mtiller,* 
Erdmann and Dodgo,* Pillsbiiry,’ and others are m conformity with 
this viewpoint 

Although it seems fairly well demonstrated that pi noticed readers 
tend to perceive woids as units, inther than as aggregates of fimaller 
elements, the impoi lance of the analytic method m building up these 
larger perceptual wholes must not be overlooked. The tendency to 
revert to n method of analysis in terms of single letters or syllables 
upon encountoriiig a new or dilhcult word was very evident in all four 
subjeots This appeals to have been the major factor in producing 
the characteristic drop in the curve at the iicginning of each new sot 
of material whoio a huge luimhei of new words were suddenly 
introduced into tlio lending vocabulary. The changes were maiked, 
not so much by mcieasc in the total nuinhcr of errors made, but 
rather by frequent licsilntioiis upon encountering new words. At 
these tunes theic was usually silent or audible spelling of the entire 
word or fioinc pint of it, or attempts at leading by syllables 
Examples follow: 

Subject No. 4 upon encouiileriitg the woid lapse on tlio seventh day 
of practice first hesitated while tho word was examined, then spelled 
Aa-p, then, unable to decide whether the following letter was an a or 
an s, passed on to the final letter which was also pronounced aloud, 
e This made ifc possible to bridge the gap, and the word was coirectly 
pronounced 

That this proceduic wis frequently employed by all four subjects is 
evident botli from then introspective icpoils and from such overt 
behavior ns the oral spoiling of words or syllables It was found to 
occur at two levels, ”iz.: m tho apprehension of single words, as in the 
(ixample given, and in tlio loading of sentonces or phrases, when an 
entire word might be passed over Lcinpoi arily to be later supplied by 
tho context In both instances, however, it seemed jirobablc that the 

* M A. Tinker' Visunl ApprelienBion and Perception m llending. PsyMogy 
Bulleltn, Vol XXVI, 1929, pp 22.3-210, 



496 


The Journal oj IHducalional Psychology 


context was not tho solo factor in supplying tlic missing element, 
but rather that it functioned in cnnricclion with certain vaguely 
perceived elements in the total form of woid or letter which were 
not at first sufiiciontly clear to porimt unaided recognition. Thm 
viewpoint is in general ngreoinont with the findiiigH of Zeiller,® Winch, » 
and Koitc.' 

It IS clear that the method just doscribed may give rise to errors 
as well as to succeshoa. Tins is ilhiHlialed by the treatment given 
to the word roused by the sniiio subject on the same day. The first 
three letters r-o-u wore spelled aloud us licfoic, and again the s proved 
a stumbling block. In this case* however, perception of the final 
letters resulted in an incorrect inlerpolnlion of tho missing part and 
the word was finally pronounced lounded- The extent to which 
this method h’as been employed may be inferred from the distribution 
of 1795 errors in which the general form of the suhslitutoil word was 
similar to that of tho correct word, i.c, diffeied from it by not more 
than two letters. For the four subjects comlimcd, the number of 
fluoh errors occurring nt the beginning of the word was only one 
hundred sixty-four, as compaicd to seven hundred lunoty-six at the 
end of the word and eight hundred thirty-five, in some intervening 
position. Tho overwhelming importance of tlie initial portion of tho 
word for total apprehension has hi'i'ii noted pioviously by Goldschcider 
and Muller,® Iliicy,* Pillsbury,’' and others. Tho corroborative 
ovidonco offered by our study ha.<4 special sigmficanoo, since it shows 
that it is the. fact of t^nlial position rather than location at tho right 
or loft side of the word which is the dclci mining factor. This factor 
is of sufTicicut strength to oiuisc ludividualw whose previous reading 
habits have presumably taught them to give special weight to the 
letters at tho left-hand aide of the. word, to rcvcisc their habits com- 
pletely with the loveisal of the usual onlcr of letters witliin the word. 
While tho numboi of cases is too small to warrant generalization, it 
IS interesting to note that the substituted woid is somewhat less 
Ukoly to involve a change in the. context in the case of tho two most 
rapid readers than with the two Blowe.r readers In thnty-onc per 
cent of the errors of this kind made by Subject No, I and in twenty-five 
per cent of those made by Sulijoct No, 2 tlio substituted woid was an 
approximate synonym for tho correct word, as e,()inpiiied Lo ninolcon 
per cent and eighteen per cent for Subjocls No 3 and No 4 icspec- 
tively. This suggesUs the possibility that tho inoie. rapid leadons tend 
to fill in tlicir perceptual gaps upon tho basis of larger context-units 
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tliaa do the slower rciidcis. A somowhul similar situation in the 
apprehension of single words is suggested by the fact that the two most 
rapid readers make a greater pciccntago of the total number of errors 
111 the middle of the word than do the two slower leaders This may 
be the result of a somewhat greater tendency on the part of the more 
rapid render to “jump over” larger areas in the apprehension of words, 
01 , in other words, to identify wouls upon the basis of a amallor number 
of “determining" elcinenls Further data with a Imgcr number of 
subjects aro needed to verify tliis hypothesis 

Errors of mlleotion involving a ehaiigc only m the pi-efix or suffix 
with the root word remaining unchanged, have been ticated separately 
For the four subjects combined, theac aic eighteen instances of a 
change in tho prolix ns compared to Unco bundled thirty-three 
instances of a change in tho suffix. The importance of the initial 
position IS again clearly rlomonsliatcd 

A total of one lumdred forty cases in which one word was sub- 
stituted for anotlici of vciy cliffcient form but of similar meaning wore 
made by tho four subjects Of those mnety-four, or sixty-sovcn per 
cent of the total woic made by Subject No 1 who was the most rapid 
reader. Again the use of largei context-units m the case of this 
subject is suggcslcd. 

OraisBion of letters or syllables fellows the same general pattern 
as substitution of Icttois or syllables Out of a total of one 
hundred ninety errors of tins Icmd, sixteen occuried at the beginning 
of a word, forty-four m tho middle and one hundred thirty at tho 
end Fifty-Rvo per cent of the total mimbcr were made by Subject 
No. 1. There were one himdiod forty-eight instances of omitted 
words, and flfty-8i\ instaiices of inserted words One hundred forty 
of the former and forty- two of tlio lattci xvcic attiibutalile to Subject 
No. 1, 

Errors resulting from a rcvcisiil of the order of leltcis within the 
word, 01 withm some ptiiL of the woid weic of fauly fioquent occur- 
rence. There woic three liundicd forty cases of complete leversal 
This category iiiclude.s all cases in which the beginning imd end of the 
word wore mtciclianged, with ni without accompanying icvcrsal of 
intervening letters. I'lxainiilo; was for saw, laid foi doU, on for no, 
etc. There were one lumdied Koventy cases in winch the icversnl 
affected only a pat t of tlio woi d, Tlieso have been cliisBificd according 
to the position of tho lovorsod portion within tho word In thirty- 
eight cases tlio ordoi of tlie letteis making up tlic first syllables was 
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reversed on initinl alteinpl, or pronunciiitioii, c.g., }ww for the first 
Byllftble of wondering ICrroiH of lliis kind woio likely to be corrected 
spontaneously, since a« n ruin llinir nature was such that the word 
could not be Bensihly completeAl witUovit eoviention In one hundred 
sixteen COBOS the initial mid liunl Ic'tters were correct, but a reversal 
was made within the word Form Uwfiom and virc verm m a common 
example. Tlierc were Hixtren caseH in which the mvi'isal occurred 
at the end of the woid, ns vnlil for until In Ihivty-foiir cnscH the order 
of words within a plunse or short scnlcnce was revcisod, as ts il for 
il is, etc. 

It 18 impossible to say to what extent these i’cvLM.Hal 8 are the direct 
result of mlerforcnce from the normal rcadinR-lmhit and to what extent 
they represent perceptual difliculllos of a moio fundamental nature. 
Every primary teacher known the ilifliculty which nioRt beginning 
readers cxpciiencc in Icnriiing to distinguish holween such words as 
was and saw, fell and let; on and no, elo. 'I’lml inteiferonco factors 
were operative to some extent, at leiisl, in the ])iesont experiment was 
evident both from the intro.spoclivo reporls of the subjects, and from 
Ihetr overt behavior. In the hegnuiing of the expoiiincnl all subjccta 
reported that the page not only appealed to be leversod from right 
to left but also to be upside down. This led to considerable difficulty 
in passing from one line to another or in going from page to page One 
subject almost invariably began a. new page at llio bottom instead of 
the top, and for nil Ibeie was u perceptible jicriod of fumbling adjust- 
ment at the beginning of eiicli new page during the eiiily pait of the 
cxpciimcnt. All found it moic or loss difiicult to shift fiom line to 
line; and not infrequently the device so often omployed by little 
children under similar dilTicultics-- that of following the line with the 
finger or of pointing to each successive line m orilor to keep the place 
was bi ought into use In spile of these doviee.s, and the ciiily recogni- 
tion of the existence of this particular typo of diflicuUy by all four 
subjects, m twenty-one ensos an entire lino was omitlod in reading; 
m seven cases a line wns lepealed, and m two luldilioniil cases the fixa- 
tion point shiflcd to the udjaconl lino without awsuenchs on the pait 
of the subject, who, as a result, read half of one lino and half of the 
following lino. 

The effect of intorforeiice is also seen in certain Icttei -confusions 
which woic frequently made It is a matter of common obseivalion 
that noimal children upon learning to road laicly have much trouble 
in learning to distinguish words or IctlcrK upon a vei lical or up-and- 
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down bnsis, bui ilutC tiie hoiizonlal, oi right-and-left distinction 
frequently causes much tioublo. As Tcrinan has expicssed it ('^Meas- 
urement of Intclhgcneo/' p. 177) “it m the and that chil- 
dieii must be told to innul, not the and “6's '' For all subjects, 
however, d and p wore confused more ficqiiontly than any other letters, 
with h and d ns a close second. Tlic opoiation of the ''up-side-down^^ 
illusion has almost ceitainly been the determining factor in the first 
instance Other letters froc|Ucully confuBcd wore a and s, h and 
and w and m In general it may be said timt such confusion is most 
appaient in the case of letteis made up of identical or closely similar 
elements, thus necessitating a distinction upon the basis of spatial 
position only 

Although it IS evident that a comparison of word-confusions or 
Ictter-confusions withm material such as this, where individual words 
or letters occuried witli unequal frequency, and therefoie had unequal 
chances to bo confused, docs not pci mi t too wide genciahzation, it has 
nevertheless seomod worth while to tabulate the woul-confusions which 
were found to occur most frequently within the limits of oui material 
The results of tins tabuhiiioii aie shown below 


OJ for to (or vice versa)^ 8S, on — rio, OH; saw — ims, 00; the — //its, 19; ihai—Um^ 14; 
te/t— /cW, 12; now — u»on, ll; IcU^lclf U; t/io— dia/, 0, the — /m, 8; /acc— /ad, 7; 
physiological — psychologicalf 7; and — <inyf 7; ilmiffli — thoiight 0; pari — past, G; hivi 
— hxSf 5; to — or, 6; ever — ciic/i, 6, tvhalcvcr — whether ^ 0, and — butf 3, started — staredi 
3;/or— o/, 3, pvt—bult 3, 

The findings of ICrdniaiiii and T)odgo^ and of Pillsbury’ appear to 
show that woreWength m an important fuctoi in the determination 
of word-form. Zoitlcr® on the other hand, regards woid-length as a 
factor of minor impoitancc Our findings cleaily bear out the former 
viewpoint. A tabulation of a total of 2812 oiiors (not including omis- 
sion or insertion of entire woids) yielded the following results. 

No clmiif^e ui numliei of lettprs, 1506 caso^, difTcience of ono letter, 1027 
caaca; of two Icttora, 202 cnacs, of three lottera, 66 eases, of four Icttcia, 17 oaBcs, of 
five loLtora, 3 cases, of six lottcrfl, 2 eases; of sovon lettora, 1 case 

It will 1)0 noted that lunety per cent of the eirois do not involve a 
cliange m word length of more than one letter An oxaim nation of the 
nature of the moat fieqiient eriors as i eported in a foregoing parngraph 
will show that in none of tliose instances is the change in word length 
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greater than one letli^r, winie ni eigli(y-iive pei eenf of the errors 
mcluded within tln,s list, no elumge in woul l(*nglh has taken ])lacc. 

Since only tonr suhji'ds partunpaliMl in the experiinenb, it was 
thought llmi il would he worth whdr lo see to what e\[ent individual 
jdio*syncrasios might be nfiVelmg the geiHTul tienil of the roaulla, 
or, >n other words, to hee to \\Iiut (‘\(c‘nl the (liKlnbiilion of the various 
kinds of eiror might vniy fioin subjeel (o aulijind We liuvo therefore 
classified the eirois made liy each Hulijcet under llie dilToicnt heads 
cliscuHsod previously, ami then eomputed llie ruuU-ouler corrclatloE 
between the com])anilive fief[uen(‘y of the various tyjKN of error for 
each flubjGcl with every cdlier subject. Tlie cairgories used in clasaity- 
mg the orrois will he repeated lieie for eonvciueiiee. 

OmihHiou of line 
UcpciiUoa of hue 
Mixing up two lines 

Omission of Irttors orsvllahln at hngiiuimg of word 

Omimon of lellcrrtor SNlluldes at cimI ctf wind 

Oiiiiwjion of loUiort or HyllnhlcH in inifldlc* word 

Siihiitiiuhiin or addition of Icltcrs at Ijrginiung of word 

Sulmiiluhon or addition of lotlcrs at end of word 

SulialiUition oi addiiiun of IrUrrn m middh* of word 

Itovoraal of entire wool 

Partial revorsid at hegiinimg of wool 

Partial reversal at end of word 

Partial reversal in middle of uoril 

llcversal of wuhU or plirniei 

Plnanca Huhqtiluled or nddi'd 

The in Lcr-coi relation beUveeii the order of fietpieucy of I ho various 
types of error for the four Bubjeels ranged from +.^7 to d-.85 with nn 
average intcrcorrclatioii of +.75 In a sindlur luunncM' wc have com- 
puted the rank-order cot lelal ions betwoon the fiocpiency of vaiious 
single-lotter confusiorm foi I ho fom Hubjeets, UHing only the twelve 
coatuaLOUB most frequently uuido, and lu this diffeicntiating 
between the two alternatives in each pmr. The list of confusions 
follows: h for d, b for p, d for b, d foi 7 ;, / foi I, p for h, p for d, a for s, 
A for hj w for m, t foi /, « for a In this east' llie iiitei-coneliitionH rimgcd 
from +.26 — [-,78 with nn aveiage iiUei-roritdiition of -|- 50. This ia 
in close ngiecment with the coirt'Hpomlence between mdividuals found 
in moat of Uio reported stiuhoH on li\e relaUve legibility of individual 
letters. 
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SUMMAIIY 

i Tlic rosulls of a learning exppi iinciit in the roacling of English 
prose from the icvnrsctl imago sliown in a mirror have been utilised for 
the study of coilain factors influencing 'ivord-pciception 

2. Pour adult readt'rs participated in the experiment. Practice for 
ton minutes <laily was oairied out liy each subject over a period of 
approximately live inonlhs. Miu ked individual differences in speed of 
reading were apparent fioin the hoginning, and those differences tended 
to incrcnBC with practice 

3 An analysis of the error.s made in terms of their position within 
the word yielded lesuUs winch arc in conformity with tlioso of certain 
previous investigators m llio following respects (1) The initial letters 
were found to be of far greater iinpoitancc in the apprehension of 
words tlian the final or the intcrmciiiatc letters, (2) The context was 
frequently utilized m the final apprehension of difficult words or in 
deciding among the various altornativcs suggested by imperfect or 
patLial perception, (3)Wor(Hcnglh appeared to be a factor of major 
importance in determining word-form 

4. Interference from the normal loading babit was shown, not only 
in the reversal of letters or of letloi-elemcnls m the horizontal direction 
winch IS a difficulty frequently found among children when first learn- 
ing to read, hut also in tlio proacncc of a definite “up-sidc-down” 
illusion which tended to proiluce siinilai confusion in the vertical 
direction 

6. A fair degice of corioHpondcncc was found among the four 
subjects in rcgaid to the lelativo frequency of the different lands of 
error made Tlio nicaii in Icr-coi relation of tlic order of frequency of 
certain specified oirors classifiod on the basis of their natuie and their 
position within the word was -f .75 for the foiii subjects; between the 
frequency rank-oidois of the twelve most common letter confusions 
was + 59 
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the retention of MIIlROR*READING ABILITY 
AFTER TWO YEARS 

FLOEENCE L CSOODENOUGlI AND MILES A. TINKER 
Univorsily of Minnesota 

I’liia study was dc'siKiiod i(» supplomcnt an earlier investigation 
by the authors' on progress m learning to read ordinal y prose material 
as viewed in a mirror 

Four subjects pailicipatcd in the oiigmal study. Practice was 
earned out for ton ininutcs daily over a pciiod of approxiinately 
seventeen weeks. 

Two years later, an experiment m relearning was undertaken. Ten 
minute pinotico poiiods wcic employed ns before. Practice was con- 
tinued for twenty conbcculivc days. The book used was “Psychology, 
Its Facts and PrinciploH,” by 11. L. llollingworth The first half of 
this book had been road at the end of the oiiginal learning study. 
For re-lcarmng the second half was used, thus insuring similarity of 
subject-nmttor without tlio use of identical material. All four of the 
subjects participated in relearning None had had any intervening 
practice. 

A comparison of the uuinbcr of lines read per day during the 
rc-lcarning period witli the coriesponriing number lead during the 
original learning is pro.sonled in Table I. 

In this lalile the moan numlioi of lines road during each successive 
five-day period of the relearning experiment is compared with the final 
stages of the original learning in winch the first part of the same book 
was used. The nunilior of days piacticc on this book was the same for 
both leaimng and icleaiiung. 

The rank-oidci of the four subjects is the same for both learning 
and relearning, if the average for tlio twenty days of practice is con- 
sidered. With few exceptions, tliis is also liuc when the data are 
grouped liy successive five-day stages Two of the foui subjects make 
a distinctly higher scoic on the ideal ning than was made during the 
final period of learning, in spite of the fact that tiioic had been no 
intervening practice. The romaiinng two subjects made appioxi- 
inatcly the same avoiago scoios on botli learning and rcleaining. 

' Tinker, M. A and (ioodonoiigh, F L. Miirov Rending ns n Method of Aiialyz- 
ing Fnefcora Involved in Woid-porception. Tins Jouunal 1031, Vol, XXII, 
pp 403 
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One gamed 0 4 of a line, Lhc ollio lost 0 (5 of a Inu* Wlicn the average 
score for lhc In hi five days of roloiirnmg ih ooitipured wilh Ihe last five 
days of tlic original learmiig, all Buhjeefs allow a alighl losa, but Ihis 
lo33 waa moio lhati recovered by (ho oiul of lhc Rccoud live-day period 
of rolcnrniiig. Those reauUs indicalo (Iml with ndull Hubjccla, reten- 
tion in miu'or-roadmg tends lo iiorsisl with ])raelically no losa m 
efficiency for n period of at leasl Iwn yeais. 



VOCATIONAL INTERESTS AND TYPES OP ABILITY 
HALPir II (lUNDLAOri AND ELI7AUETII GERUM 
1 IjiivtTHily of Wnsluiifitoji 

This paptn pu'KOiils fstunulca of the mtei-coirolaLioiis belwcon 
fifteen of tlio vocalioiiH iiieusurod by Strong's Vocational Interest 
Blank, and offeis u parlinl analysis of the types of interest which are 
in part lesponsiblci for the (legioc of correlation. 

Wc have several tunes found a need for a knowledge of the inter- 
relations between the various occupational groups ineasuicd by the 
Vocational Intoicst Blank. The manual of directions contains 
figures of intci-conclations foi about twenty pairs of vocations; but 
there are stencils and norms for almost that many occupations The 
manual, further, gives no indication as to the mimbei of cases upon 
which the correlations arc based, oi the PE’s of the correlations It 
would bo an enormous task to work out the actual intci-correlationp 
with an ndcuuiitc number of cases, 

Our own efforts were dirccletl toward obtaining, fairly easily, an 
estimate of the actual coi relations Instead of using scores made by 
various individuals upon the tests, wc used the stencils thcmselvesi 
instead of using the fully wmgliled semes, we used only tho sign of the 
score, and insteiid of iisnig llio total blank, wc used only foui of the 
sub-tests (lA, IB, 7 unci 8). A lelative iiieasiu’c of tho degree of 
correlation in interests between two vocations in each of these sub- 
tests was oblamccl by delci mining the number of agreements in sign 
m the "Like,” “InchITeient” and “Dislike” columns for all items; and 
fiom this figui'c was subtracLi'd the number of agreements which would 
be expected puiely by chance When these data from all the voca- 
tions and sub-tests used were added and assembled in a table, the 
rough relations between the various occupations could be sccu, but 
their flignificaiice in torma of the coellieicnt of con elation could not, of 
course, be determined. To make a convcision possible, these figures 
wore correlated with actually dctciinincd coriclations between voca- 
tions. The actual coi relations were obtained fiom those published 
in tho manual of directions and fioin Coirelations we had determined. 
Strong does not stale the number of cases upon which Ins correlations 
are based Ours aie based only upon fifteen to foily cases When a 
value for any pair of interests occuricd in both somces, the average 
was taken. There weie finally thirty-four different coirelations, 
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ranging from —.10 to 88, whicli were plotted against the correspond- 
ing estimates. Tlie correlation between the actual correlations of 
interests, and the cstiinatcB of ngrooment, based upon the signs of tho 
weightS) is .918 ± .0175 By metina of the obtained regression 
equation each of the values in tho table giving the lelative closeness of 
agreement of the vocational interests was convoiled into its moat 
probable coiiclational valu<>. Table T gives these estimated inter- 
corielations. The p]0„,. i.s ,076. As a clic.ck, the chlferenccs between 
tho Lliirty-four actually determined and the corresponding piedictcd 
correlations were plotted • The Thl of the distribution was .079 

Even a casual inspection of tho. table shows many indications of 
group factors. Since the actual basis of the degree of correlation 
between any pan of vocations can bo found in the stencils, an analysis 
of factors involved could readily bo made pioviding there was a 
significant set of categories for classifying tho various items. Follow- 
ing Tliorndilco’s suggestion ilml there aic peihap.s three types of 
mtelligenco, and assuming a close lelation between inteiest and ability, 
wo first attempted a clnhsificalion in Lcims of the categories, Abstract, 
Mechanical and Social. It soon appealed that those classes needed 
amplification and subdivision. After scvcial trials, what appeared 
to be a fairly com]ilelo cla.Hf.iricalion, with five main headings and a 
total of twelve sub-headings was constructed. Three of the main 
headings coriespond to Thorndilco’8 AlisUnct, Social and Mechanical 
intelligenco. The remaining headings collect the lalhor miscellaneous 
sub-groups that filled in no particular place Nino diffcient indi- 
viduals, representing five dopnrlinonls of instiuction, acted as judges. 
The judges classified the itoina in entire independence of each other; 
and m view of their complaints ns to tho difficulty of making the 
classifications, tho amount of agrcoinent among them is surprising 
Tho judges omitted a number of iLoins which they held weio not 
classifiable into these typos of catcgoiies. Hence only the first four 
sub-tests of the Blank iveie eventually used T!ie judges were asked 
to indicate which items they felt belonged under tho following headings- 

(A) Social jntorcsLB 

1, Dcsiro lo doinmaltt or hOHn a Rionp (auny oHicor) 

2 Dosiro to ho oxlnbitod hofoio a Kroiip (actor) 

3 Do'jire lo minRlo in a ciowd (incnic»), 

{B) IritolIccUml intcrostH 

4. Empirical (p]»yHio«) 

5. Abstiacfc (iTJfttlio/rmtjofj), 
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{C) Technical interests 

0 Clerical (bookkeeper) 

7 Mecbamoal (auto lepan man) 

8 Technical-professional (dcntiat). 

(D) Creative interests 

9 Artistic (aitiab) 

10 Practical (music teacher) 

(IS) Interest m physical skill 

11 Competitive (auto racei) 

12, Noji-compctitivo (taking walks) 

Those items which four or more of the nine judges agreed in classing 
under the same heading were consideied as properly placed. All 
others were omitted, 

It remained to compare each of the slcncila for the various vocations 
with this analysis of the interests, Any item m the Interest Blank 
may be marked ‘^Like/^ “Indifferent*^ oi “Dislike.” For any partic- 
ular interest any of these alternatives may bo weighted much or little, 
and with a plus or a minus score All “Incliffeiont” scores were 
Ignored. Only fairly heavily weighted positive or negative scores 
(four or five, depending upon how many such items appealed in the 
paiticular vocation) were considered. Score was totaled by counting 
one each for positively weighted “Like” items and negatively weighted 
“Dislike” items; and by subtracting one each for negatively weighted 
'^Liko” items and positively weighted ^'Dislike” items Accordingly 
it was possible in BcOYing one vocation to have a count of isero, one or 
two (plus or minus) for every item Table II presents scoics obtained 
in this fashion for fifteen vocations for the various types of interest, 
converted into per cent of perfect score The Minister's scoio, e,g , 
of fifty per cent under Creative artistic interests, means that that 
profession had a score of seventeen on these seventeen items 

Considering the various vocations as wholes, it fiist appears that 
none of the vocations can be said to depend only upon one or another of 
the major groups of interests. A very important factoi seems to be 
what members of the vocations dislike. Real Estate Salesmen, and to 
a lesser extent, Lawyers and Journalists, are characterized chiefly by 
their almost universal dislikes, while the Ministcia, and to a lesser 
extent the Teachers and Personnel Managers, aio characterized by 
omnovorous likings. The inteicsting characteristics of the individual 
vocations are too numerous and too readily observed to bo noted 

We may now turn to the relations between the groups of interest 
If Thorndike*s suggestion that there are thiee types of intelligence 
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IS true; and if, as has been fairly well established, there is a close 
1 elation between abilities and inteiests, then the coi relations between 
the classes within each of our major hcadingvS should be high, and the 
con elution between any member of one group and any member of 
another group should be low. To facilitate such a cornpariBon, rank- 


TAULn III. — iNTEnconnBLATioNB HETWBBN TUB Vaiuous Clabbbs of Intbuebtb 
(Hank-difference Method) 
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T 

A 

P 

Ph 

Snoial 












B 


63 


02 

22 



64 


- 10 

.60 

B 

63 


28 

^ 12 


33 

^ 22 

■s 

04 


36 

M. , . 


28 


■i 

■ 



■ 


■ 

20 

Intellectual 












E . 


- 12 

■S 


so 


34 


47 

40 

- 36 

A 

22 

-29 

■ 

89 


43 


41 


66 

- 33 

Technical 


m 


■1 






m 


a ... 




H 

43 


28 

68 


BE 

19 

M 

40 



iB 


28 


03 

11 


,17 

T.. 

64 

■ 


■ 

41 

68 

■ 



■ 

25 

Creative 












A . 

- 10 

04 


47 

46 

00 

,11 



88 

01 

P. 

— 10 

-- 10 

.10 

46 

66 

13 

26 

32 

88 


-.18 

Skin 












Ph 

GO 

36 

20 

“ 36 

- 33 

10 

17 

26 

01 

- 18 



Social, B — boss, B — exhibitor, M — imobtiuaivc mniglcr 
Intellectual, E — empirical, A — abstract 

Technical, C — cloncal, M — ^mechanical, T — technical piofeasional. 

Creative, A — nr tie tie, P — practical 

Skill, Ph — physical, compotitivo; N — non-competitivo has too few oases 

order correlations between the classes of interests wore worked out 
(Table III). Fairly high correlations obtain between the two Inteh 
leotual and between the two CrcatiYO classes of interests* The various 
Social classes and Technical classes, howovei, do not bavo such high 
intCTcorrelations. In fact, the averages both of the coi relations of 
Clerical interests with the three Social classes, and of Practical Crea- 
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tive infcercsttJ with tlie two Inlcllectual clussea arc liigher than the 
average inter-correlationa eillier of llip Social or the Technical olasscH 
of interest. 

If our fiiittl «naly.‘ttH is correct, thf giouping of "Social” mtercsle, 
and of “Technical" inlcie.stH into auigle calPRoiles covens up many 
actual dilTciencea, Wo cannot agree that the lorniB "Social," 
"Abfltraot” ami “ Mechanicur’ aland for Ihrca homogcncoua, mutually 
independent, and colleelivi'ly exhnuative categories of ability. 



A VOCABULAllY STUDY OP BIOLOCiY NOTEBOOKS 
OF FIFTY llEFRESENTATIVIi) SECONDARY 
SCIIOOIS IN NEW YORK STATE 

DON 0. BAIRD 

AbsooiaIc Professor of IliologV) Hnm Iloiiston Htate Tpaohois Collrgp, Hiintsvilli’, 

Tetne 

There hiwc been many vocabulary studies imulo lu icccnt years, 
especially in the field of elementary education Thorndike's “Teach- 
er’s Word Book” ivas a result of an extensive and comprohenBive 
study of the vocabularies of elcmenlai'y pupils and average citizens 
Recently Seiko made a study of words in ten well-known textbonke m 
spelling in which lie shows very clearly that the problem of vocabularies 
IS by no means solved. Powers made a “List of Scientific Terms for 
High School Students, ” m winch ho lists the moat important words 
from the field of natural science for pupils of the high school level 
Many others, as Bonscr, Doran, Nchcr, Braiulonburg, and Symonds, 
have contributed to research work m the vanoiis iihases of vocabulary 
investigations 

The study hero piosonted was made to determine whether there 
is close agreement in the vocabularies used m biology textbooks and 
biology notebooks as written by high school pupils, and to compare 
the scientific terms used in such notebooks with those found in Powers 
“List of Scientific Terms for High School Students” and with those 
found in Thorndike’s “Tcachci’s Woid Hook ” 

The writer collected biology notebooks from pupils in fifty repre- 
sentative secondary schools m Now York State These notebooks 
were selected from the sevcial classes in secondary school biology 
as good but not the best of each biology class The pupil vocabulary 
m these notebooks was examined to determine tlic following, extent 
of pupil vocabulary, extent of the use of scientific terms, the total 
number of woids used, and the coirect use and spelling of words 
The total of all the separate words used in the notebooks was 
checked against the Thorndike list and the Powers list. In mailing 
up the list of words used in the notebooks proper nainivs and symbols 
were counted m the total count for all the notebooks. The first step 
in discovering the extent of the pupil vocabulary as loprosentcd m 
the notebooks was a study of one of the smaller and one of the larger 
notebooks for comparison and to provide an initial woid list for further 
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study. Tabic I chows the icsuUs from tlic comparative study of the 
two notebooks. 


TaDLB 1 — SuMMAn\ OF VoOAIiUl.AUY OF OnE OF TUB SmAI.LBR AND OnB 

OF TOR LAHORII NOTHHOOiCS 


1 

1 

Hiiinller 

iiotobcok 

Larger 

notebook 

Number of words used Init om o 

167 

G63 

Number of words used one lo four times 

313 

1,223 

Number of words used live m nmre tunes 

100 

668 

Total fleparate worilfl used 

422 

3,781 

Number of proper namoH 

16 

121 

Number of symbols used 

10 

74 

Numbor of abbrcvmlionH used 

4 

4 

Total number of words used 

2,220 

16,249 

Total number of words, ineludmg symbols, proper names, 



and abbrevmtioim 

2,260 

16,448 

Numbor of words not found in TIiornditc^B list 

61 

287 

Number of scionlinc terms not fouml in Powers' list 

7 

68 


The total nuinb(M‘ of ficicnlifie toims Ubcd in all the notebooks is 
SIX hundred forty-five Many of llic seiontiflc trims woio used but 
once in a ainp;lo notebook, (lompaiatively few woids wore found 
to be misspelled and but few wokIh ''coined^’ by the pupils. Table 
II gives ft sumnnuy of Iho vocubulaiy study of fifty-Lwo of the 
notebooks, 


TaDLIJ 11— SUMMAin 01 * HIM VooAlUJLAUy »Sl'UDY 


Total number of words URiul . 488,820 

Total number of flepaifito wokIh uned 2,3G8 

Total numb or of worils not fmiiul in Thorndike's list 344 

Total number of wordn not found in Powers’ list 87 


Tadlb III — WoiiDS IN Tiin Notmijcoks Not Found in Tuorndikii'b Tbaciibr’b 
Word Hook, ok in PowLim' List or iScniNTiFic Tcums ior Ilraii Sckool 

Htudlnth 


Absorption 

Amoeba 

*Apex 

♦Astigmatiam 

Adaptation 

Arnidubm 

Aphid 

Auditory 

Acloiioids 

*Anal 

Append age 

Aunclo 

^Advocacy 

Anoiilielen 

♦Aliena 1 


Aeration 

Antennno 

Artery 

Bacillus 

Agar agar 

Anther 

♦Ashy 

Bactoiia 

’^Ahead 

Antibody 

Assimilate 

Daoteriology 

Alimentary 

Aorta 

♦AHHunilation 

♦Bag-liko 
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tadw. nr 

—Contmiud 


*Bailorfl 

CoinbusLion 

ICpnlei mis 

Iiidigo3til)lc 

Bast 

Complex 

Erosion 

Inorganic 


Concur e 

KsophagiiH 

luBecla 

Beaker 

Gouflcrvnlion 

Kthor 

IhHolublo 

Bciioficml 

Convex 

EiJHlnclnaii 

luloguTnent 

Diohlornlr 

*Coiivolulioii 

♦Kvcrv limo 


*BiGoncavo 

Coordinate 

Excietion 

ICntydid 

•Biciiapid 

*Co(>rdninlion 

Kxowkclclon 


Bile 

Cornea 

Explode 

Labium 

BioloRy 

Coiolln 


Lacteal 

•Blottci 

CoipiiQclc 

Facet 

Larva 

Boll 

Cortex 

FahrenVunt 

Lavyiw 

*Box elder 

Cotyledon 

♦Fiui-likc 

Lateral 

*Bioiioliial 

*Coxa 

Fobling 

liOgimio 

Burdock 

Cl ay fish 

Fciinontation 

Length wise 


*Cioss bill 

Filament 

Lonticol 

Calyx 

*CroHS section 

Fillor 

Liberate 

Cambrmm 

Cioss-i)ollinato 

♦Flo\vor-lik(» 

♦Licoiico 

Capillary 

Ciuciblc 

Focus 

Limeatonc 

CapHulo 

CruHlacra 

Follicle 

*Lv8o1 

Carapace 

Cytoiilnsin 

♦I^nk-hke 


Carbohydrate 


Fonnaldeliyilo 

Maggot 

Carpel 

*Dnddy-loiiglcgs 

Finingale 

Malaria 

^Carrion 

* Do area so 


Mam mal 

Caudal 

Dolimoent 

CiAHtnc 

Maiuhblo 

Cavity 

*I)crangcinoiit 

Oencmliiialioii 

•'Mandrake 

Colluloao 

DevftHtato 

Gonomle 

Masticate 

Cephalothorax 

♦Dexterity 

Cionninalc 

Maxilla 

Cerebellum 

Diastaao 

♦Glottis 

Medulla 

Cerebrum 

Dicotyledon 

Gram 

Medullary 

Char 

Dioxide 

Guppe 

Membrnno 

*ChUin 

Disinfcotaut 

Gnllot 

Membranous 

’^Chlorate 

♦Dissect 


Merge 

Chlorophyll 

♦DissenBlou 

ITcliotiopism 

Moso thorax 

Chloroplaat 

Dormant 

♦Ilcasiaii 

Mctamar|)ho3is 

*Chylo 

Doraal 

♦llibcnmlion 

♦Mctathoiax 

^Chyme 

Diupc 

Hydrochloric 

Metazoan 

Cilia 


Hydiogen 

Micropylo 

Ciliatc 

♦Ectoplasm 

Hydrophobia 

♦Microaca 

*Cinnainon 

Edible 

Hydroxide 

Microscope 

Cloaca 

Embryo 

Ilygiono 

Microscopic 

Clot 

♦Emulsion 

Hyg ionic 

♦Mold 

*Gocoufl 

Encyst 

Ilypocolyl 

Mollusk 

Cochlea 

♦Endoplasm 

Hypo -pharynx 

Monocotyledon 

^Cochineal 

Endosperm 


Monocotylcdonou a 

Coeklcbur 

Eniiymo 

IcliQiunnon 


Codlin 

♦Epicotyl 

Ignite 

Nnicotic 
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Taiilk in ^ (Jonlinucfl 


Ncceasitatc 

PlinloHvnilu’HiH 

Knlixu 

‘Sunlight 

♦Neuron 

PliyfliologK 

•Sail vary 

iSwiiuineicl 

Nicotino 

PiKiiiniit 



Nitric (ncid) 

Piniiulo 

♦SawdiiHl 

Turhuui fly 

NitroRcn 

♦Pmr(‘H 

Scavenaor 

Tnctilo 

NitrogonoUH 

Pmtil 

Hncnfiflt 

‘Taproot 

Nodulo 

PlnrcMila 

•Hclnrolio 

‘Tolson 

♦Non-fatty 

Pinsiiin 

SchiicfoUH 

Ti'sla 

NucIoub 

*Plial)l(‘ 

SlTlClO 

Tliomoic 

Nutrient 

Plurnuln 

Hpcrotum 

Tliorax 


Pollinalion 

Hrgcinoiit 

Tilua 

♦Ono-ccUed 

Ponio 

Segiiicnltil 

Trachea 

Oporcuhim 

Po'ilpner 

Snif-f’ontrol 

Tran 4iu cent 

Opium 

Polasmiiiii 

♦Sf'inioircnlnr 

♦Transparent 

Osmosis 

ProtfMii 

*Sf‘iiufluul 

Transpiration 

Ovary 

♦Protlionix 

SenHoiy 

‘Tncliocyst 

* 0 vcr done 

Prolopllisiu 

♦iShorluig 

*TrifiUHpi(l 

Ovipositor 

Piolo/oa 

Solnhlc 

♦Tnilurn 

Ovule 

Psoudopofha 

KpiMulc 

♦Trochanter 

Oxidation 

Ptvjilin 

Kpinlluni 

Trypsin 

Oxidize 

Piilinoimrv 

Mporc 

•T«rtHO 

Oxygen 


♦iSpuUci 

♦Twrezora 

Palisado 

Quaninluio 

Sputinu 

Sltuncn 

♦Typhoid 

Palmate 

l^ahn ‘4 

•Htarling 

♦Unglazo 

Palpus 

♦lUikerH (dill) 

♦StoapHiii 

Urea 

Pancreas 

♦Uajdir 

♦Stcgoriiyiii 

fJrolor 

Pancreatic 

Uodox 

Slonh/iilioii 


Papilla 

Ho]) reduce* 

Stigma 

Yarn nation 

Paramecium 

Ueprodnction 

Slinuilaut 

Vacuole 

Parsnip 

*lle«piraUon 

Slumiliitf* 

Ventral 

Pectoral 

llcspi ill lory 

Stimulus 

Veitoiirato 

Pelvic 

Ilclnia 

•Stipule 

Viroo 

Pelvis 

Ilhiibaih 

Sloma 


♦Pericardium 

llodpiit 

Slomala 

AVcevil 

Petiole 

*Uo(l-slin|)c 

♦Stopper 

Xylom 

Pharynx 

Hoot let 

Suffocate 


* Nat 111 Powora' list 

Concluding, tho wiitor would Huy is ovidont ihal biology Hjls ii 
technical vocabulary more or loss peculiar to it, and tbat the acquire- 
ment of thm vocabulary by piipiiu is no easy task '^J'horo is a con- 
siderable range of HCKMitille Umius used m the aeveral textbooks of 
secondary scliofil biology unci, an found in the notebooks, sonio of these 
torma are used but once liy pupils Tins would .seem to indicate that 
the technical vocabulaiy of the tnxtbooka may well bo aimplified, 
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cspcohilly Hiiico many of the? Hcloiiliric trrnm an* not found In Powers^ 
'^Liat of Scioiilific Terms fcjr Iligli Kcliool SUhIoiUh,'* The fad that 
relatively foAV wordn wore nuhspelled oi incorrcciUy imed in noteworthy 
It IB also evident llinl a Keneral voetOndury of leas than two thousand 
words ifl Bunriciont for the averufre |ngh scliool pupil m Iho study of 
elementary biolo^^y 
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MECHANICAI. “APTITUDE” Oil MECHANICAL 
“ABILITY”?— A STUDY IN METHOD 

0 h IIAIIVEY 

In 1928 John Cox, a pupil of Spnarmtin, stated tho majoi* findings 
on bis clocfcorale djssoilniion''’ on inpclianicn! aptitude as folloTO: 

Tho npplicatiDii of Uio Ictiad-differeiico oriteiion U» our opccilio coirdntion 
coo/T^cjonts )his fiiilrd to diHrloHC tlio pjwiino, Iioro, of group factors , TJio 
jc^iiltinfi; appcifio con ok I ion is adequately c\ plan) eel by a Hingle factor running 
through those moftsuiomonls in wliich Lhia con elation occurs (130) 

In a biicf (liscua>sioii of ils lolalion to othov ho pointed 

out that mechanical apLitiulc** is to bo strictly (lifTeicntiatcd from 
“motor ability/* which form of activity was “specially avoided** in 
hl3 tests 

Seeing, howevci, that the pnccption of space is largely developed by tho aid 
of motor sensations, and that the nmloiml of tho tc*?^ was spacml, it might appear 
at first sight that motor activity was an mdiierti determinant of success in dealing 
wiUi thia raatciial But the pieeise efllmialion of shapes, rixcb, and distances, m 
whieh motor c'xpeiirnees might eoriceivahly jday a part, was not required in tho 
teats, The essential pioeesses on winch success or failure turned wcie not per- 
ceptual but of ilm cductive kind m which motor expouence could haidly have 
assisted (107-108) 

In the inilial clofinitioii of liis problem, conccining ihc use of the 
term “aptitude/* Cok wiotc 

Since the term “aliility " must oliviouHly extend its meaning to cover any kind 
of pciformancc wlialovci, it woiikl seem desirable to continue its employment jb 
this wide senso, and to iiso the toiin “aptitude^’ whf^n only the innate character of 
the ^‘ability” le intciided Employing llio lerins in this wav, we should say tliat a 
person actually able to cany out ^‘moolianiciil" work lias '‘mechanical ability,** 
while QUO who has tho apiiropiiatc innate mental constitution for acquning this 
ability (whether he has aclu/illy done ho oi not) may bo said to possess “mochnnieal 
aptitude*' (40-41) 

In these three koy-sinteinents, then, Cox makes Ins posiUon dear, 
namely: 

1 That ho sought to discovei, if possible, fclmt innate "aptitude*' winch iindei- 
lirg tho ability to oany out inofthaiiiLal woik, 

2 That, as tlia result of cx])ciinionlialioii, hucIi an aptitudo was found actually 
to exist; 

3 That li IS unique iii Us irlation to "p" (f^poai man's “grncial f no tor"), 

4 That it IS a single gioup fnrtoi , and 

6 That it 18 not the same ns irioloi iibiliiv 

* Cox, J W ‘ "Mcchanicftl Aptitude ” London, Motlioiin, 1928, pp 210 
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Tlio infltriimenls {U*sIh) um'(1 I>y Clox of mechanical 

models and diagrams of various wills, wliicdi his hubjocts were required 
to explain Or compleio in one way or anollier, verbally, That is, the 
function of Lho subjeols was (•‘^sontiiillj^ imUicIivc, non-manipulativc, 
non-motor Although it may be argiuMl Unit, for ihIugUvo processes 
to be possible, cerlmn implicit motor ichponws must have been 
involved, at least in live ply'll juaiviyhytnm of hubvln, mwcilholeps the 
actual IcsUsituation involved no ovcit ncuro-muscular behavior 

Two yoai’s after C^ox’s woik had been publuslu'd tlioio appeared a 
compreliensivo study of mechanical abihfy’*' made possible by grants 
from the National Koscarch Oouncil Prcauinably C!o\'s work was 
unknown to the authors of this volunns at any rate until after their 
own study had been comph^ted, for no rofcronco is made to it. Their 
findings me, nevortheless, at least in their major rofoumcc, the game 
aa his ” As regiucta the uuuiucucisg of meolmiucal ability/' they wrote, 
^'tho evidence is consistently poBiUvo" (258). On tlie other hand (m 
contradiction to Cox's findings), 

jncclmnicnl nbijity . piolmblv don not involve' iiny Hinglo gciioial factor, 
Low iiitorcorrolations Ijotumi difToronf- intniHuros nf inerluiiurnl ability suggest 
that factors of high spccdieity pliiy a major rOlo (300) 

Mechanical ability tlioy found to bo ''uniqiK' with lespoct to intelli- 
gence and iilflo with respect to motor agihty'' (801), this last term 
being used flynonymously with motor ability,*' and being measured 
by means of parts of the Garfid motor (gymnasium) test 

The tonn 'bnechanical ability" was defined in this study to mean 

tlic ability to guccocil in the aoliial mimipulatioii of tooh and inatenala and the 
ability to Bccuro information about tools, and luaionaN, aiul then uaes (7) 

It 18 to be difforontialed fiom mechanical "capacity," (a term 
which, to the present wnlci, appears to be somewhat synonymous in 
this context with Cox's "mechanical aptitu<le"t) 

Tile position of the co-auLliois of this gioup-study is thus made 
cleai, as follows: 

*PaLoraon D (I rtf. • Muuiosola MoohaiiU’al Ability 'IVala Minnesota 
UuLverflily Ptc»a, 1030, pages XXtl CM 

t "Capacity/^ wroto tho aiithoiH, "j« always an infonnico fiom measured 
ability . For it is by no tnoans evident that tho dovclopmeiit of mechnnical 
ability may not be deter mined to a oonaidetablo ox tent Vw tliii proven co and 
availability of tools and mechanical equipment” (7-8) 
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Mechanical ” Aptilndc^* or 

i. That wuRlifc /)/srovf‘i \vl*(‘l)i/T thrio w'm> a ''iiicolianical ability/' 

that IS, Iho Ui Hurccnl in Ihr iictual inanipnlatioii of tools and materials, 

rcgardlcs'i as to wlioihor nr not IhiiL “iibililv” ho onlnoly attrihulablo to innato 
capacity; 

2 Tliat, OH llio uulroino of rxiK'umoiiliUuni, tlioy have lovcalcd snrb an 
ability; 

3 , Thai it la muomMii relalioii to veihal niUOli^{once, 

4 That it IS, however, piohiihly not a single group faelor, hut a ron a tell at ion 
of factors of high apiM’iheily, 

5 That it IK uiuijue in relation to innlor agdily. 

The inslruincnls (tosts) h(*l(‘eteil an lh<‘u hnal bailory for Ihc 
measui'cmonl of Ihm ‘'iiu'eliuniral ability^' ooinprizo; (a) a test of 
steadiness, (6) a caid-Hoilnif^ lost, (r) a liloek-packing test, (d) a 
form-board (spall al-rel at lonn) loHl, (e) an assembly lost, (/) a lest of 
mechanical knowledge (.St(»fKimst\s ''inechunical aptitude “), and ({/) 
a paper formboard leslr Of these, the fiist three would appear, at 
least in the jnclKincMit of Iho wnlei, to be closely siiniUvr to tests con- 
stilulmg part of the Miles-SouHboro motor skills” unit;^ whereas the 
spatial relations and assembly I (‘sls involve considerable manipulation, f 

In so far as llies(‘ two studieH botli cluiiu to have isolated and 
discovered they agn‘e, m so far as one clearly demonatiatos 
to bo a vsmghi gioup faidoi, wbei(3aH th(‘ other (Kiually clearly 
shows that very probably it is not a single Rioiip factoi, but inlhcr 
consists of a iuinil)er of highly Hjiecific faclois, they aic m frank 
contradiction 

IVofcsfling to he no moif‘ limn an inteiosled onlookei m respect to 
the present diHcussionH m this field, the wntm has, novel tholess, 
ventured to seek evidanations foi this (loniradiciion He submits 
the following aigumenf.s, lliei(‘foie, with considonible difTidence, Imp- 
ing morcly to attempt to cleai up the dilTormiooR which he finds, 

Dkfinitions, and Delimitation of Field of Inquiry 

Possibly a Hignificiint roason for the diffeicnce in findings lies m 
the definition of the field of investigation Although both studies 
claim to have revealed uotimlly Oox limits hm investigation to 

the aptitude whicli malu^R meehaiu(?iil ability possible, it excludes 
maiupulativo abibly; it disils pmely with the cognitive processes 

’‘A fiLudy not iru'buird in (.ho Minih^sota bibboguiphyi but ropnrtcd in (iotaU 
m i/oHrnnJ of Ocncral /^ni/rhn/ftfff/, Vol 111, I OHO, pp HH-af) 

tin tins connection hcc rrilioisiu by Cfov (pp lb^2l, l(K»-l()8) 
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involved m Lho eduction of spalud lelatums Tho Mnineso la study, 
on the contrary, clearly seeks to inenwro jnanipulativc ability pure, 
the ability to use tools and mntcMiala. If, then, tho ability to educe 
spatial relations is a function actually distinot from tho ability to 
manipulate objects, it would appear evident that confusion has arisen 
out of the use of the doHiKtinlion "ni ” In winch case, poiliapa all 
that is neceasavy m to ilceule on wiiuo otliei syiuboUo ileaigiuiUon (or 
the factor of “mccliaiiieal ability ” 'J'he real diffi'roiice, however, 
appeals to 1)0 more fundamental than one of dermition alone, as will 
appeal in the later discussion 

Basis oi' Sephotion of Ti:bts 

In line with the difference in definition of fields of inveatigalion ia 
the difference in basis of solcction of tests, (iox decides against all 
available tests and consliucls his own — tests involving, bo it noted, 
no overt manipulative or inoloi activity on pnit of his subjects, 
Thus it could be argued that Cox's claim that "m” is not related to 
motor activity is substantiated by (kTinilioii Tli<' Minnesota group 
is equally consistent, but atiiclly in terms of technique, not of philo- 
sophical orienlalion. Tests, rouglily designated “mechanical,” arc 
coirolated first with vorlial mtolligence and Ihmi with a shop-ciitorion, 
which, although of high lohabihty, is nevertheless, fiom the point of 
view of functional integrity, a somewhat ambiguous eonglomoratc 
Those tests which corrclftte as low ns povaible with iiitcUigencc and 
as high ns possible with the eritenon aie selected to constiLulo tlio final 
battery — a basis of selection comparable, one suspects, with judgment 
in terms of the letter rathoi than of (he spiiit of tlie law 

Spumous AVEHAOK iNTliltCOUIllil/A'nONS 

Indeed it would appeal that tho nature of tlic tests (iotormincs the 
outcome. One actually expects Cox to discovci maiked consistency 
among his tests,* On tho other hand, altliough the Minnesota tests 
are to bo cleaiiy differentiated from vcibnl intelligenco, the fact that, 
taken as a group, they result in a low average mtercoi relation does not 
.necessarily mean that here is ovidonce of the absence of a huge single 
group factor. An examination of Tubh* XXXYI (page 2311), “Intei- 

* It 18 not necessarily implied by tUm aigiiinent that Cox's “wt" factor includes 
all nvailablo tests of "m " Tho ilcrioUition of n Ri(iu|) ruclov, as the writer imdcr- 
Btarids it, is a inatlcr of pioof, winch Cox has not siihinitled Nisvei theleia, so 
fai as ho has gone, Ins tests consmtontlj^ agree 
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correlations of raeclmnical al>ihly tests used m expeiunont pioper, 
corrected for attenuation,’* yields an interesting observation aug- 
geetively in confirinnlion of tins connnont Teals 1, 2, and 5 are as 
nearly as one could wish tests siniilar to those described by Seashore 
{loc ctl ) as puiely inotoi tests; whereas Tests 4 and 7 arc oasontially 
'‘manipulative" and probably iu part ‘‘cductivc" — that is, in the 
sense in winch these ternis in e used by Cox in the critical review at the 
coiniricnccmcnt of his (hi'ais. The average mtercorrolalion of all 
seven tests is .27. Hut, when taken alone, the average intcicoirclation 
between the tlncc motor tests is ns low as .23* while the corielation 
between the two tests involving manipulation is actually aa high as 
.63. And a siiniliii argunient applies in lespcel of nil of the tables 
aubinittcd on jmgi'S 432-133, 235, 238, and 232 \ Intorcorrelate the 
tests winch aic, ns nenily us one can judge, purely motor; intcrcorre- 
latc, again, tlioso winch are both nuinipulativo and cductivc, exclude 
altogether those winch fall into neilhci calcgovy, and consistently 
one diacovers ti lugh average mtercoj'i elation for the inanipulativo 
tests, while the inotoi tests nilercorrclnto oven lower than the nvciage 
for the entire table ns given liy the anthois, and in each case the range 
of correlations is nai rower. Does not this suggest that possibly tho 
icason for low inteicoiiehilions, the high specificity, discovered by the 
Minnesota gioup is the fact that most of the tests used by them are 
actually little moie Ilian motor tests, and tluiL their “m" is really 
pielly much the saine "factor" ns that which Sonshoio clnims to 
measmo — a coiislellalion of highly specific motoi skills? May we not 
look hcic for the fundamenlal difference between Minnesota’s "m’’ 
and Cox's? 

A prion theic would appeal to be foui phenomena winch one should 
distinguish in dealing with mechanical activities: 

1 Specific inoloi hIciUh pi'i h* (jis uidicated by Scnshoio); 

2 MaiupuhiUvo or inecliiiiiicfil ability (wliicli the Minnonota gioup sought to 
measure It is not, according to Co\, the siiiiio aa the ‘^piaclical ability” sug- 
gested l)y Macfailaric), 

3 Mccbaiucal aptitiKlo (an iiilcllcotivo activity involving tlie ability to educe 
apace rclationa ijotween olijccls, without ncccssiUtnig then piclionsion and mani- 
pulation); and fiemlly, 


* 0/ Seashore's uncoircctcd intcicoirchition of 26 

t U IB appreciated tliat in eveiy case tbeie nio only two inmupulation testa to 
correlate The auggeation contained in this aignment is ncvoalhclcss Bustained, 
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4 The sheer intollcftivr ftielor, Inbellnl "g" by Spcdrinon, wlncli prcsumebly 
pervades nil ooKmtivo nclmty, inrhidinn thr nu'olmnienl 

The Minnesota Rroiip sooins io have (*r>l, home of Uiene concepts 
confused I'Tom the point of view of internal nonsislcncy its battery 
would appear to bo far superior to (lox's. In so far as its beat battery 
of testa (not only inecliamcal) correlates liiKli (about .H) with a criterion 
of excellent reliability (about ,ori) it la piobalily perfectly satisfactory 
as a incasiiri* of sltill in shop-work iierfonned by junior biRh schooi 
boys. The, study is splendidly watei tifflit Hut, in view of tho above 
arguments, one wonders whether its assumptions are entirely war- 
ranted. Cox's position, at least in Iheoiy, appeui’.H to be the more 
securely Icnahlo ITis tests aie consistent in that they deliberately 
exclude motor and luanipulalive activity in Uieir iininodiate solution; 
and m that, ticfore filially ileterminiiig the oigamzatioii of “m," Cox 
ohmmatoa (or clniins to have elimnuitefi) the infUionee of “g‘‘ from 
lus tests. 

On tho other hand, Co\’h iimteiial us vague and often exce,edjngly 
unsatisfactory. IIis populalioiiH arn heleiogeiieinm (by comparison 
with those of tho group study) and mo.st of (hem ton small The 
.same testa have not been viaed on all groups tvlike. And one is left 
with an uncomfoi table suspicion that 8ucces.s m answering his tests 
(no scoring procedure has been indicated) depeiuls to such an extent 
upon verbal mtelligence, that “m" (even when, to all intents and 
purposes, the induonco of "g" has been ehmmuled) still contains a 
powerful amount of "g.” 

It might be an intoicsling piece of rcsoareh to aiuilyso m terms of 
tho tetrad diiTcrcnce technique, llio data obtumable fioin a homo- 
geneous group in lusponse to (a) a test of viu'bal intelligence, and (J) 
a combined battery including tests such as (1) the Minnesotn assembly 
and spatial relations tests (for “mechanical ability"); (2) a selected 
group of Cox’s models, explanations, etc. (for “ mechanical aptitude"), 
and (3) either tlie Minnesota tests for steadiness, oard-soi'ting, packing 
blocks, and tapping, and Link’s machine operatois' lest, or some form 
of motor skills battory, similai to that developed by Soa.shorc (for 
“motiUty"). 

Cox and the Minnesota group have demonslrated how such an 
investigation can bo couduclod I’ossihility an experiment along the 
lines hero indicated might help to clear up tho basic i.ssue.s involved in 
thoir major disagicemenl. 
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TUo probh'in h(‘i(‘ uMompH'il ih (d ili'U'iiniiK' hy objpctivii iiipana 
the I'plalivo pffoil of cliildron of ijalivi* as. f(HCl^n l)()rn ])aicnts. The 
interest in this Hfudy gicw out of iccoKiiUion of Iho tendency to clis- 
cnminale nflainst the foieiKiiei in the inunnor wliicli lie applies liiinself 
in accompliRhmg school tasks. The significance of such an expciimcnt 
may bo inoie fully appieomfod ivlien ive.Hlop to considci llmtappiox- 
imately one in every eight, or l.lui teen per cent , of the population of the 
United Slates is of foreign liiilli. 

The AQ, 01 Accoln)ilisliinc*iit (iuolieiil, is used us the, index to 
effort The AQ is tlie hXi (educational cpiolient) ihvidcd hy the IQ 
(inlclligcnco quotient), C^iioling fiom the 'IVoiity-Fiist Yearbook,* 1 
“The IQ is a ineasuri' of the native, alnlily of the, cliihl and shows his 
potential rate of in ogress. T'he Eti is a measure of t he oduoalional 
attainment of the cluld and shows his actual rule of progiess. The 
Accompliehincnt Quotient is the degice to wliich his actual piogiess 
has attained to his potential piogii'ss by the best possible measure of 
both. It IS a mark whleli evaliuili'.s the aecomplislinient of the child 
in tciins of his own ability.” Fiaiizcn’* 8livtc.s, “Riiiee the IQ is the 
poLenlinl rale, of piogiess and th(> ICQ is tliu actual rate of progress, 
the ratio of the ICC^ to IQ gives llie ptscenlage of what the cluld could 
do, that he has actually done Tins would he a murk of the child’s 
effort, a mark of coneentiatioii and inleicat that the child has in school 
work, and so fivi as no othei inlierited traits than intelligence affect 
school work it is a inensiire of the ciRcicncy of a child's education 
thus far. If thoie are such olhoi innate bases it is also a measure of 
inheiitcd trails, sucli as concenlialion and effort At any latc, it is a 
mcasui'ii of the child's accoinplislunent, and so of the effort and con- 
centration as tliey leally nio at present woiking undei those school 
conditions ” Witty and Lidnniui'' defining Hie A(J say, “The AQ 

*T1iq writer ih iiuli'liti'd to J’lofcnsor .riiinCH P l*(uli!r of Ohio UnivorHity foi 
guiclaiico in this ftliuly 

t Numboifl iiuticnlo roforonce lit Ijililiogriipliv 
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ifl a compaiisoii of the I'iA (('(IhcuIioiuiI at;e) to the MA or the EQ 
to the IQ Deviationa above and below 1,01) inchciile tlic extent to 
which effort IB expended tiiid ability ewicised in the tiiBke of the school, 
Presuiimbly un AQ of a l.OO iiidioalea lluiL the nioutal ability and 
the educational iiUanuiieiit of (he clnhl oi Kroii]) tuc developing 
coordinately." 

CloodenoiiRlP icinindH uh tlmt iiii migrant RroupBuiul Iheii iiimiedi- 
etc doacendiuilH differ maikedly in then pi'ifonimnce.s on (lie ordinary 
type of inlelliKcnce lest Khe hurkohIh (wo (heoru'B to account for 
these differences The iuht ascvihes (he iiifi'iiov sliowiiiR to such post- 
natal factor-s as infciior envhoninent, pool physical condition, and 
linguistic liaiidicap.s. The sccoiul jecoRin/,eH to sonic dcRiec the effect 
of these factois on tcsl-iesuUs, but holds (hat it is iiupn,SHiblo to account 
for nil the fads wliicli have been obseivod upon any other hypothesis 
tlian that of iniiato diffcreiicos. She, Roes on to say, "Although n 
test iH completely indepeiuionl of luiiRitaRO, llu* mnk order of various 
racial groups coriespondH very closely (o (h<‘ icaults of other investiga- 
tions using verbal te.sts ” 

Many cxpcrinicnls have been iiiKlcrliiKi'n anil lepoitod lolativo to 
the hnguialic handicap with whieli the fnieigner ih faced when ho 
takes a tc.st desigiicd to ineiisure all childieii Iml, has Ikmmi sLandardized 
on English speaking groups. 

Brown® has made an Invest igation on retiiuiulien in several schools 
in northern Michigan. Tic found (Ivcie wan a wide variation, in 
rotai'dntion among the cliilihen of dilTeieiit nulionaliLiea, It was 
revealed that after a inipil of foieigii born paieiils had attended an 
American scliool for one or two yeais, he tested as high by employing 
the English langiiagc as by using (lie native tongue 

Young® in a study earned on ni llie San .lose schools in winch he 
used the Army Alpha and Bela Tests on Anieiican, Iliilian, Poitiigiicsc, 
and Spanish Mexican chiklren, found that (ho Alpha 'I'cRt piovcd a 
better measure of tlio Latin groups than the Bela lie concluded that 
language handicap was not the cause of school clilliciilly. 

Jones’ made a comparison of the scoros on the Myois Mental 
Moasuic and the McCall MuUi-Menlal Seale, discovoring theic was 
no appicolablc difforpiicc between the semes iiuide by the niilives and 
those made by the foreign, ft is contended that the foimer test is 
largely non-verbal while the latter is highly veibal 

A stalcinont from the 'I'wcnty-Meveiith Yombook liy Bulks and 
Kelley roads,* "Wo find studies that purport to ineasurc the effect of 
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language handicap on verbal inlclhgonce test scores by comparing 
the mental ages of foreign childion earned on verbal and non-verbal 
intelligence testa. The mental ages of children of certain low testing 
nationahtica commonly turn out to be closci to the norms of American 
children when incnsiiied on non- verbal tesla than when inoaaured on 
verbal ones But in ns much aa verbal and non-verbal test scoies, 
even for Amci ican children, seldom corrclalc with one another higher 
than 6 or .7, it is ohvioua tliat, although both types of test are called 
'intelligence’ tesla, they mensiuc about as much not held m common 
ns they mensuro of wluvt is held m common. Ilenco, it is not legitimate 
to infer from such data alone that language handicap accounts for the 
low Bcoics of the foreign children on vcibal tests.” 

Although further investigations will bo necessary to settle the 
question, the foregoing citations have some eignificancc May it not 
be reasonably assumccl that some peisonahty trait such as effort is 
playing an important v61o? 

MuTIIODS and PUOCEDUIIB 

The schools selected foi making this study aie located m raining 
communities of Athens County, Ohio Appi oxiinntely ninety-five 
per cent of Llic worUeis arc employed m the mines. Under normal 
conditions the economic situation is goneially good. Due to a stuko 
which has lft.ateil for over a ycai a severe depression has developed. 
For the most part, foreign atandnida of living prevail The church 
and school are tlic chief sources of culture. 

The gioups under considointion consist of the childien from the 
fourth to the eighth guide See Tabic I foi a detailed statement of 
nationalities Tho.so whose' paients luc foreign bom constitute the 
one group and those childien whose paicnls arc native bom make 
up the other group All childien were boin m America, but the 
majority hear a foreign language at home The pupils of both gioupa 
are of much the same social status Arlitt® omphasizes the importance 
of taking this factoi into account She finds thcic is a marked differ- 
ence in the dietiibution of inlelligencc in groups of childien of the same 
nationality but of a dilTeieril hocml level 

It was recognized at the ouiset that thoic was a selected group of 
natives, (lootlonougli* UMnark.s that a person of low intelligence tends 
to gravitate to those iieighhoi hoods wheie tlic economic requirements 
are minimal; and, once llune, lie rcacth lowaid his surioundings along 
the lino of least resistance ]''iom peisonal observation and inquiry 
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il, was learned I bat no prejiuhco or favonlmin <‘mhI<h1 on t)m part of the 
teachers. The native and foreiKn were trealed alike* 

Tlio hearty cooperation of the teachers aiul principals was had 
throughout The pupils inanifosl(Hl u guMit deal of iiitoroat lu the 
tests by giving close attention to all instruotuina arni Hiiggostiona of the 
examiner.* 


The tests uHod weic tho Otis OInsmfieation 

Forms A and B, and 

special tpflls of the scnleiico coinpW'Umi ami awditory memory typo 

TATinn I - DiHTIUHUTlU?^ OF NATJO.VAM'IinH 

80 I 100 I A 


NATior^AMTir 

No OP Caber 

Amoncau 

65 

llungaiian 

23 

Polish 

24 

Oorman 

0 

Proncli 

13 

Italian 

3 

Slavish 

4 

Lilhiianiun 

2 

Foreign 

76 

Kativo 

66 

Total. 

MO 

School B 


American 

98 

Hungarian 

46 

Gorman , 

4 

Polish 

1 

Foreign 

60 

Native 

08 

Total 

148 

School C 


American 

08 

School I) 


American 

43 


* Most of tlioso pupiia wore aenisloinctl to Inking Btnnduulizod toslfl. Form 
A of tho National InlolliKOiiec Teat and Forms A and H of llu' tltanforcl Acluovcj- 
meut Teat 7 /crc gwcu the preceding year m an effort to deter n\me the mllucncc 
of apeoial mtonaivo training in vanoua acliool Hubjcctn While the rofliilts, wliori 
conaidored from tho point of view of tliia atudy tend to coiifiun tlio findings hore 
reported it has srcincd beat to omit further mention 
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Tho general procedure was to ndminiator the fust form of the test, 
then after n period of a few weeks give the second form of tho same 
test 

Tho problem naturally divides itself into two distinct appioaches, 
each of which will be considered separately. 


Tbs'i' Findings — Paiit I 

In attempting to detcinuno eftort by using tlio AQ as an index, 
it was decided that tho Otis Clasaification was the best oxainmation 
available, in that, it is composed of both the so-called educational and 
mental ability tests. Tho finst form was given in January and the 
second in April. The AQ for each individual on each test was derived 


Tadlb II — Tub Median EQ, IQ, and A.Q ion tub Fonu Schoolb on Form A op 
TUB Otis Ci.ahsipication TrsT, also Quaiitii.e Eanob fob the AQ 


School 

EQ 

IQ 

AQ 

Quartile 
lango of AQ 

C 

82 77 

8G 81 

96 36 

7 08 

D 

82 01 


06 04 

G 02 

A (Nfltivo) 

80 78 

8G 54 

99 42 


A (Foreign) 

84 6 ' 

74 8 

103 28 


B (Nntivo) 

70 C4 

81 69 



B (Foreign) 

83 12 

81 30 




in the way pieviously slated Only losults from those pupils receiving 
i)0th forma aic considcied The different grades m Schools A and B 
were highly comparable in numbers of each sex, and in relative numbers 
of foreign and native 

The reason for giving the two forms wasfoi the purpose of checking 
the consistency of the two groups in achieving school work within the 
same limits of time 

Schools C and D wcie selected and tested to see if the absence of the 
foreign affected the academic achiovcraeni of the native as determined 
by these tests. 

Tabic 1 1 gives tlic median lOQ, IQ, an<l AQ, foi tho different schools 
and groups The iiuartilc range is also given foi the AQ In Table 
III aio tho same data on the second teat. 

Ill Fig. 1 and 2 are given the cuivcs foi tlie median AQ on the 
two tests for the two gioups by grade 
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Ta3ilb hi. — Tub Median EQ, ICJ, asd AQ foktiie Thiibb Rcuoolb on Fohm B 

OF TUB OtIB Cr^ABRIPfCATlON TeHT* AOSO (itJAUTILB HaNCJM FOII TJIB AQ* 


Scliool 

m 

IQ 

AQ 

QuaHile 
range of AQ 

D 

80 83 

84 01 

03 m 

7 03 

A (Native) 

88 7 /i 

02 7 R 1 

07 6 

6 00 

A (ForeiRQ) 

88 06 

87 81 I 

100 08 

8 .U 

n (Native) 

84 37 

88 84 

! OC 

6 02 

B (Foreign) 

88 1)7 

87 

I 102 6 

7 76 


* Ab iSchooI C lincl (hsinmfirtl for thp «mnnu‘r tbo ap^^ond to'jt could not be given 


Toot I 



Median A U for two groupE) 


A q 

Toot II 



"by grade In Toot 1. 


by prado In Toot II, 


Foreign 

Ufttivo 

Fio l.~ -School A. 


lie 
110 
106 
CjlOO 
^ 06 
00 
65 


Toat I 


Oradeo 




Median i Q for two groups 


ToBt II 



Modlnn A Q fqr two groupa 


by grado in Tost T. 

Eia 


by grade in Toot II* 
2 “School Ih 


Tables IV and V give the porccnlagc of foroiga roiicliiiig or oxcccd- 
ing the median of tlio native. In other worda, the figures represent 
how many foreign avo as good as or bettor thnii half of the native 
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If the peicentaf^e is gioaler than sixty or less than forty it may be 
considered significiinl Rtarcli^^ states that any diffciences lying 
between forty per cent and sixty pci cent of the number of cither 


Tatilk IV — Tim Peugrntage of Foiikicn Ueacihng oii Excdeding tub 
Me n IAN OF THE Native on Form A or the Otir CtiAHRiiTCATioN 

'I'rsT 


f>c'hoo] A 


Grnclc 

4 

T) 

0 

7 

8 

EQ 

33 3 

66 

23 


60 

IQ 1 

33 3 


30 7 



AQ 1 

1 73 3 

00 

70 0 


70 


►Srhool B 


EQ 

76 


40 

76 1 

33 3 

IQ 

100 

HM 

23 


33 3 

AQ 

87 6 

■n 

84 G 

7fi 

83 3 


Tahle V — Tiik rmuKhTAon or Fohkkin lliiACiiiNu oii Exckedinq tub 
Median or tiiii Native on Form B of tub Otir Clarhification 

'i'ERT 


Bcliool A 


Grade 

1 4 

6 

0 

^ 1 

8 

EQ 

■■ 




00 

IQ 





10 

AQ 

■I 




80 


School U 


EQ 

87 6 

80 

G1 6 

60 

33 3 

IQ ' 

76 

60 G 

38 4 

60 

16 G 

AQ 

87 6 

100 

84 f) 

62 5 

66 G 


group reaching or excised lug Llie median of tlio othci arc piactically 
negligible If sixty per cent of one group leacli oi exceed the median of 
tlio otlioi it moans Dial ten poisons in a Iniiidicd of the one group, are 
by a small amount suinuTor to the othei 
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Taulb VI. — Tub rBitcENTAOB oe I'cmBtiiN' Hbaciiinh ou Bxcebdinq tbb 
Median of the Native on I'oiivb A ami ll of tub Otib 

(’.OAB,HIFICA'IION Tfbt 



Form A 

lorm H 

All forrjKii III Briiool A , ! 



m 

4!) \\ 

C7 0 

Ki 

11 

4/j S 

AQ 

SO 

on 0 

All foreiRii in hcliiml U. 



KQ 1 

IIS 

74 

Ki 1 

CO 

CS 

AQ 

SO 

(iS 

Foreign in A niitl li: 



m 

41 0 

6B 4 

IQ 

62. 

42 4 

Ml 

70 

1 

07 2 

I’AIIT 11 


Tlio control problem la liote apptouclied from ti dvftcrent angle 
than tho preceding experimenl Special lenta wore dovised after 
Sentence Completion and Auditory Memory Tests of Otis. The first 
typo of teat is made up of aenlcncca from a given etory 'with words 
or phraacB omitted. It is llio, pupiVa task to fill in these blank spaces 
with appropriate words that lie may liiive a latlH'r complete story 
when ho has finished. A list of possible words follows each set of 
seven or eight sentences Tor example: Once wa.a a loiriblc 

giant ogio. 


pleasantly 

their 

story 

died 


fiercely 

crawl 

terribly 

lived 


there 

Hitting 

built 

pass 


Tho best word le Ihete, consequently it is placed m tho blank space 
It will bo recalled that tho second type of lost depends on llie ability 
of tho pupil to retain and recall evenlB menlioned in a Htory wliicli lie 
hears read. For example: "Was Gotham known foi its wondrous wise 
mon? (yes, no, didn’t say). Tho correct response is “yes” according 
to the story, thereforo this word is underscored. 
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There woic two Bots of Llicse oxaminalioiis’ the first set was given on 
April 12 and the second on Apiil 20, 


Tadld VII — Mj^djan BrouEs foh Tim NATivii and Foubign on the Sentence 
CoAiri.nrroN and Auditoky Memouy Tkstb 



Foicign 

Native 

No of examination j 

1 

2 j 

1 

2 

Completion teals 

12 22 

14 ! 

16 10 

14 26 

Momoiy tests 

14 00 i 

16 38 

16 63 

14 72 


PerccniflKO of foreign loaohing or exeooiling the medinn of tlic oiitive 


No of o\amiiiaiioii 

1 

2 

Coinplelion tests 

36 2 ! 

41 1 

Mommy tests 

73 6 

73 fi 


The ComploLioii and Meinoiy Tenls had thirly-Gvo questions or 
statements each, TIh' score was the numlier an.sweiGcl coirectly 

At the close of tlie fust test the pupils were told that in two weeks 
the examiner would bo back to give iliom a fainiilai set of questions 

Table VIII. — Median Scoun rou tiik Native and Foruion on the Two 

Ev\MINATrOVH JN TJID BeVENTH OiUDE 



l'\neign 

Native 

No, of oxami nation 

1 

2 1 

1 

2 

Completion tests 

Memory tests 

12 

13 85 

14 10 

10 26 

17 

16 26 

17 6 

10 26 


Pereontago of foicign lOficlimg or oxcoocliiig the median of the native in the 
seventh grade 


No, of exiuniniitioii 

1 

2 

(^onii)lotioii tests 

37 6 

02 6 

Memory t{‘slH 

43 7 

02 6 


and incomplolo scnlenceH They weic advised that the stones from 
which these losts would bo compiled were to be found in specified 
books in ihoir library, and that fioin the six stories the names of which 
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wore placed on the hoard, two would k‘ivc us tlie hnsisof the second 
examination. No fuitlicr supKcsttons wore fiivon, 'I'lie touchers were 
requested to make no furlhcr inetilion of (he woik. 

Table VII Rives tlie lesulls for Ui(‘ 1 wo Rioups iii the two examina- 
tions Table VIII Rives the iohuUs for (he (wo Rioiips on the two 
examination H fni the M'veiith Riuile, the leiisoii foe seleediiR (his partic- 
ular grade Ix'iiiR that thou* woie tlU' sumo luimher of the foreign 
and native 


DlSCOhSlON AND ( JONl’iniHlONH 

When. Colviii'^ compared (he heoiea euiiied, on tlie Otis Gioup 
InLelligonce Scale, Forms A iind B, by cliildieii of Brookline, Massa- 
chusetts and Cincinnati, Ohio lie found the liitiei to he infeiior lie 
attributed this mferioiily to dilTeienceH in oppoilumi les to learn words 
and acquire slvill in Lhoir use lie auppoiled Inn conclusion with the 
fact that tho childron in llio poorer 1ocu1i(k'h in Brookline did not 
score as high in the entire Lest ns did the ehihhen in the more favored 
localities In tho Arilliinotin lest “hugely non-veiiiul in its nature" 
the scores wore not inferior to those mudo by the children iii the bolter 
sections. 

The results of our own study would Heeiii to siippoit Colvin’s 
contention. Tho scores on the eiilire lf'.st weie lowei tliaii the estab- 
lished nouns Ilowevoi, ii|)on a caieful exainliiulion of the Aiithinc- 
tic problems of the Otis Cliissiliciilion it was found that both gioups 
did eciiially well. In view of tins fact it is apparent that both gioups 
wcic competing on an appioximalely equal hasifl with iTferciico to the 
language factor. In no case was it discoveied lliat the foieign weie 
moio handicapped lmguis(.ioally than the native 

From Tables II and HI it may be ob.M'rved tlial in all cases the 
foreign make a higher median AQ than the native. It is tnic that the 
native make a higher IQ hut the ililleieiiec is .so slight that we cun 
attach little, if any, significtince to it 

Fiom those result, s it is evident that the native are more highly 
selected than the foioign, (lie qiiaitilo laiige in AQ is gieatcr foi the 
foicign Rioup, Inspection of fiO(|Ucnoy diatnlivitiou tables also sliows 
greater variability The selection of tin* nalive is emphasir.cil liy the 
fact that nearly fifteen pci cent of those taking the first Le.st had moved 
from the community by tho time of the second 'I'liis accoiinls for 
the limited number of cases in the sUuly, us wt* considered only those 
pupils who wore tested both times 
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The schools in which no foicign wcie found, tested on a par with 
the other two schools. That there were no foioign in Schools C and 
D was learned fiom quosliounaircs filled out by the pupils and con- 
firmed by the teachei.s An attempt was made to get information on 
the different grades with lefeicnce to median AQ. Figures 1 and 2 
show a gieat deal of Huctuation, but it will be noted that the foreign 
and native gioiips align Iheinscivcs in emves exhibiting marked 
consistency. 

The eighth grades of Schools A and B were vciy small Table 
IV and V present data which might lead one to conclude tliat the low 
IQ of the foreign was lesponsible for their high AQ. Where this 
difference occurs the probable explanation is the smallness of the 
class. 

Tabic VI shows the percentage of foicign reaching or exceeding 
the median of the native to be at least significant. 

In approaching the problem by the second method, the Special 
Completion and Memory Tests, it was assumed that the group showing 
the most improvement would bo putting forth the most effort. This 
assumption could he reasonably justified on the basis of the preceding 
experiment. Tables VII and VIII would indicate the foreign to be 
superior, Intoi eating detads in connection with this second experi- 
ment are: Of seven who were effortful enough to read the stories for 
the second examination, five weie foiPign; the coi relation between 
the two examinations was 79'l with a IMO of 032 

Our study may have something in common with an mvcstigation 
which has been cniriod on by Millei*' with fieshman cngineeimg 
students at the University of Michigan “The low students arc, in 
the main, children and grandchildicii of Araorican-born men and 
women. They also aie the sons of the bcttci educated and moic 
prosperous parents. A surptisingly large peicentago of the high 
students aie the grandsons of foieign-born men and women They 
are the sons of paients having little education or none In tlic main 
they aic the sons of pnients who.se education does not include the 
high school Twenty-foui pei cent aie the sons of paicnts who had 
less than a grammar sehool education ” IIo furthoi slates. “Low 
students are lacking in liie quality of vision, poweis of analysis and 
cooidination. 'I’hey nii* superiicially bright and ingenuous, but Ihcii 
tcnaciousness of puipo.se anil capacity for sustained mental effort arc 
so low that tticir curve of effort Ims a .steadily downwaid trend ” 
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May not the above diacu88ion and our fincliiijrs suggest a possible 
nud partial explanation for Lho pievniling opinion of the thrift and 
rapid economic rise of the forLMgnor? 

Some conclusions to be cliawn fiom this study may bo briefly 
slated as follows: 

1. Groups of childien of fonugn-boin puienls arc coiiBislcnt in 
making liighcr inodiun Aehievemoul Quotients than are gioujis of 
children of native-born parents 

2. In most cases the median Intelligence Quotient is slightly 
higher for Iho gioup.s of native cliildreu tlian for llie fmcign. 

3. Both gioups woio handicapped in the use of language as meas- 
ured in all the tests* 

4. TliG foreign have little or no inlnbilmg oi unfavorable influence 
on tlic scliool progress of the iiativo, 

5. By the use of objeclivo tests the foieign jirovo themselves 
superior to the native in effort Tlic relnlivo 8igiu(icanco of this 
poreouality trait is at least miggeBlod by the manner in winch the 
foreign overcoino obstacles iii making new adjusLmeiits 
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THE EFFECT OF THE FOJIRI OF A COIHEINATION 
IN THE LFAIININO OV A IMUI/ITITJCJATTON TABLE 
BY BKIGIIT AND DULL CIULDllEN 

K. T. Wri/SON 

iStftlo Teiu’hcrn fJollogc, TJiiffnlo, New York 

In an cxpcuincnlal sludy lopoiUkl oLcwlionf,' H(!lc(!(,ctl gioiips oI 
Gtlcen cUildicn each, Icarnntl a miiUiplicatiou acrica fiom 2 X 07 to 
9 X 07, inchisivc. Practice wna provided by a caul, upon which the 

67 2 

eight combmatione appealed in liolli vortical forms, that is as 2 and 67, 
with the answers given at the bottom of the caul in both horizontal 
forms, that is, as 2 X 07 = 134, and 07 X 2 = 134 The children 
read the combiiialioiiH above orally, and found the answers by looking 
below and Rvvmg them oially. Tlie subjects wcic bedected by individ- 
ual test with the Slunfoul Itcviaion of the lliiiel and by clironological 
age. Half of them were practically nine years old and half twelve. 
Halt ot each of these ages weie of Hi’s between eighty and ninety, and 
the others between one hundred ten and one Inindred twenty Pull 
description of the subjects and the technique of the experiment arc 
given in the rcfcience cited above 

The table shown herewith gives the locord of the eoircct answers 
of each group A sinking likeness ih seen in noarly every pair of the 
combination forms. In only four mscs are the diffei ences in the scores 
of paiis more tlinn five. Invosligalion of the do lulled records indicates 
thot these are puiely chnnee lesuUs, exjilainable in the small number 
of rc8ponse.s in ccitiiiii iiislnnces and the cumulative elTccL of very few 
subjocls tn small scores 

Tho mam point of inleiosL lu those data Hec'iu.s to bo not so much 
that, in learning the answera, the two foiins of iin uiithnietic combina- 
tion arc of no particular difference in chlficulty, as that there teem to bo 
no chstmguishiiiR didercnccs in that regaul bctwemi cliildrcn of rntlier 
low mental ability and othois of lathcr liigb nionlal ability In 
effect it.seeinb to suggest that the Icaining jiioccts, whatever it may bn 
in ultimate elements, is much the hiuuo for dull and linglit. This is 
supported by other ovideuco in the lahle not stiessed in Lius report 
because it has boon treated moie, exteiidedly elsewhere, namely, that 

1 Wilson, P. T.* “Tlic TjcarniDK of Itriaht loid Dull Childrun " Tcnehcre 
Collego Con tribe lions to Educnlion, No. 25)2, 1028 
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the combinations which were haiclcst for the bright weie also hardest 
for the dull, and that the combinations easiest for the dull were also 
strikingly easiest foi the bright. 

These pomia tend to turn the inteiost of those coneerned with the 
guidance of loaining processes of human beings to two concepts said 
to bo at present of some psychological repute. They are, first, that 
human beings, despite gicat variations in abilities and interests, learn 

Tadlh I — NtJMnBU OF Conimca' IIebponsks to Each Form of the Combinations 
BY TUB Dulu and BnionT Groups 



in much the samo way one to anotlici. Tlieie are differences m rate, 
accuracy and letcntivcnoss of Icanung, but basically theie seem to be 
conditionH and piogress of like kind The second concept is that a 
learning task Huch as Ihi.s ia attacked and pi ogress made m it m a way 
which suggests the unity or wholeness of tlio entire matter, rather than 
a separateness of pai Is Grasping the plan of the task, as expressed 
m an answer, the mind seems not to be disturbed, perhaps, by the 
arrangement of pai is, but seeks to handle the material as a whole 
















STUDY HABITS OP TKACTIUHS C'OTXPXiK STUDENTS 

nucni M iJKLi. 


Rtfilo TrnHirrH (Vjllogp, Oliiro, Cnlif, 

The quaHtion of the innounl of (mio kivcii (o Htudy ih of importance 
to both tlio student and to tho luliniiiiHlriilor. Stiulonts m a teachers 
college, piopAring to gui<h' olhors in leanung, need oBpeclally to 
dDmonalralo to Ibemaplvea the lelatioftftlnp winch cx’ihIh he tween their 
study habits and Ibcir Bcholiislic iicbiovomrnt Fioin the adminiatra- 
tor’s standpoint anything appioacbing suocwful student guidance 
cannot bo ntlamcd without <l('fiiiito infoniialion m regard to study 
activity and tlic relation it beursi to inlplligoncp and scholastic 
standing. 

In this investigation we sought to answer thcHo questions; When 
do students study? How long do they study? What is the nature 
of their study activity? How is the amount of study time related to 
intclligonce and scliolarBliip’ 

Students in Gonoial and Educational PBychology classes were 
used as subjcols, The invpsligation was conducted duniig the school 
year 1928-1929. A, total of ono hundred twenly-seveii HtiulcnU kept 
daily records of their study time for twenty-eight days Kccording 
was not begun until after tho third week of each soniobter. Keeping 
the records was considered a pm t of the regular work of tlic courses, 
Every effort was made to secure the cooperation of the Btudents since 
this type of mvcsligalion depends so much upon it. Tho instiuctor 
took onc-lmlf hour of tho period on tho day that the record blanks were 
given out to explain the purpose of the investigntion and to .show them 
the importance of keeping the rocouls carefully Each succeeding 
week when new blanks were given out the stiulonla were again urged to 
keep tho recoida faithfully. 

Tho study iccord consisted of a specially piepaicd sheet on which 
columns wcie provided wherein the student recorded each day’s 
study activity. Tho students were given HiifTicicnt record blanks for 
one week. At the end of tho week they turned m their records and 
got a new sot of blanks. Columns were piovidod in wlilcli the students 
could record the following information; 'i'lme of Btudy —the day of tho 
week and whother it was done in tho morning, iiftornoou or evening, 
type of study— whether reading in a textbook, outside reading assign- 
ments or written work such as themes and piolilems. 
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The study day was divided into llireo poiiods; Moiiung, from time 
of arising until twelve noon, afternoon, from twelve noon until six 
o'clock; evening, fioin six o’clock until time of letiring. 

Dumig the school year all the students were given the American 
Council of Education Psychological Examination Repoits woie 
secured from the registinia office of the grade points earned by each 
student in all subjects foi one aoinester, Coi relations weic computed 
between study tune, scholiirship and mtolligonco. 

ItESULTS 

From analysis of the 355G days of study reported by the group, 
as shown m Table I, Ihoio was a total of nearly 396,000 minutes, 6683 
hours, given to study by the entire group ovei the period of four weeks. 
This would bo an average of ono hunched cloven minutes, oi just short 


Tmjms I — Tima op Day When Study Was Done 


Time of day 

Number of 


Average numbei 

1 m mutes 

Per coat 

minutes poi 
student^ per day 

Morning 

00,493 

1 

24 

27 

Afternoon 

126,167 

32 

36 

Evening 

173,340 

44 

49 

Total 
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of two houiB per day for each Btudenl. Twenty-four per cent of the 
total study woik wna done in the morning period, thirty-two per cent 
in the afternoon, and forty-four per cent in the evening. The results 
indicate that neaily ono-lialf of the students’ studying is done in the 
evening by artificial light The nverago iiuinbei of minutes per student 
per day for the moining pciiod is twenty-seven minutes, for the after- 
noon thirty-five minutes, and for the evening peiiod forty-nine 
ramutca These avcYagca assume that all students studied on each of 
the twenty-eight days that the investigation coveiecl 

A companson of the study activity on the vaiioua days of the week 
18 recorded in Table II. The number of minulcB lecordod for any 
given day is the sum of all the study tunc repoi ted by all the students 
for that clay. Tlicio is a gradual iiicroase in the amount of study from 
Sunday to Tuesday where it begins to dioii off to Thursday. Fiora 
Thursday to Sunday thcic is a pionounccd chop The most outstand- 
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i»K (]voi> 18 fioui Tlvvu'whvv lo FiuUiy wlwn k-sH lime was given to 
sludy tluin on luiy otlior day of tlin ivcck Tliti dilTercnce between 
Saturday and Fiiday ifl nut M mueli im one iiiirIiL liiivo ttuppoacd. 

Ill llic second column of tins liililt' the averuKO, number of minutes 
per day for cuch Hliident m jcporled In tlioKO aveiagi'H iho actual 
number of fitudoiitHHludyinRon a giveii day is tnkeii into coriHiclcrntion 
In Table I whcie llie numbrn’ of aUidi'iils htudyinn on a given day was 
not tiikPiv into account, it nppi'arcd (bat, on (bo avm’iige, oiir students 
were Bludying one houi and lifty-one ininuti'H per day. In Table 
II those ivbo did not aliuly won' elinunaled from the averages and 
the mean incipascd lo two boura and llurteen ininules. 


Taiicb II — tJoMi’AtiiHON ov .STCDr ArTiviTv ON V'ouoiiH IIayh of TiiH Week 


l)ay« of Nvci‘k 

Nunibci of 

Daily 
umuher of 
mimiU'H iH*r 
aUuk^it 

Numlior of 
Htudeala 
wtudyiTig 

' Per cent 

Sunday, 

PI, 800 

128 

8 13 

07 

Monday 

0(1,733 

HO 

470 

04 

I'ucsdfty 

83,488 

lOH 

005 

09 4 

Wcdncfiday 

72.88I 

HH 

488 

00 

ThurBdny 

00,203 

idO 

400 

97 0 

Friday 

33, 41)0 

\V1 

374 

73 0 

Saturday 

26,217 

m 

213 

41 


The number of stiulonlH htmlyniR on u givi'ii day in reported 
in column tlueo of Table TI, Tliia lepresenls tho total for the four 
week period Thus if all the BludenlH bad Nliulied on a given day the 
Number of Studcals Studying would have been five luindrod eight since 
there were one hundied bwonty-hoven Kludenls who kept lecoidsfor 
four weeks. In the fouilii column llie per cent of studenls studying 
on any given day ia shown In geneial tlio niimher of .students study- 
ing shows about the saino tendeney lo incicase or decioasc that tho 
number of mimite.s shows However, there me inleieHling exceptions 
to this. The number of stiulenls engaging in Htudy increased from 
Wednesday to Thuieday, hut (lie duration of the stiuly peiiods 
docieascd. There ia a greater numher of students .studying on 
Friday than on Sunday, hut the total numlier of ininiiLos given to 
study on Sunday is twenty-four per cent gieiiler than that on Friday 
There ia a goncial tendency to deovense tlic length of the study period 
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as the week-end approaches A comparatively small number of 
students, forty-one pei cent, aro studying on Saturday, however, their 
study activity BCcniH to bo of a better quality than Friday's in as much 
as it is carijcd on for longer periods of time Both fiom the standpoint 
of the numbei of students studying mid the average length of tunc 
given to study, Tuesday lends to be the best day of the week for study. 

Book,^ in a i<'(!ont investigation of leading among college students 
states that if. has been cstiinalcd that the aveiage student gets ninety 
per cent of his infoiinaiion in college tioin some type of reading 
activity In Table III evidence is presented which appaicntly sub- 


TABliB III — CoMl’AUlHON 01- AaIOUNU QV TiMB (JilVKN T:0 RbABING Al^D WbIT^Q 

IN Study Activity 



Reading activUios 


Writing activities 

Textbook 1 

Collateral 

Piobloma 

Papers 

Number 

minulcfl 

Pci cent 

Number 

niiiuUos 

P('r cent 

Number 

miiiiites 

Per eoiit 

Number 

inmutcs 

Per cent 

100,886 

63 

1 30,530 

19 

1 13,562 

1 

[ 8 5 

14,280 

0 5 


atantiatcB this ostiinato Not all the stiidcuts signified the type of 
study, whether leading oi willing, and hence oiii data lepioscnt the 
reportb of only tlioho who did, The total number of minutes foi those 
students who signified the type of study was 159,257, Of this, sixty- 
three per cent was given to leading textbooks; nineteen pei cent to 
leading collatoial material, 8 5 poi cent to working piobloms; and 
9 5 to writing [lapors and Lheines 14iglity-two per cent of all the study 
time was used in eonio iypij of leading activity and eighteen per cent 
m wilting work This is, of couise, only a lOugh estimate since some 
types of study aic didicuH to classify under the above headings 

Since some students cany heavici scholastic loads than others it was 
no.cossfiry to devisr* a ineiins of eqnaliKing this difference before deter- 
mining the average study tiim' foi a given student to be used in our 
coirolatLons This was aecompliKhed by finding Iho average number 
of minutes per week spent in study and then dividing this by the num- 
ber of units 01 lumrs can khI foi Qm eemestor This gave the numboi 

’ Book, Win F , How Wc^ll (Jolli'RO iStudfiita (Jan Hoad School and Sociatt/t 
Vol XXVI, AiigusL, J027, pp 242-248 
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of minutes studied for iv Riven hour of school work Courses which did 
not require prcparallon, snch ns iihymeid e<luc{ition iictiviliea, were 
eliminated . Wlicn the student’s Rriules and study time were correlated 
the Pearson r was -p.Hl? d .()(“>. Tin* coofiici(*nl, when prades were 
correlated with inlelURcnce, was d-.ri(ifi t- tH. IiiteUiRence correlated 
with study time +.003 + .00 The (ust two eoeflicionls are approxi- 
mately tho same as securt-d liy Muy' in an earlier study of tins same 
characlor Ilowevor, he secUicd a ni'piilive coirclutum between 
intelligence and study lime Using I he pin Iml coiioliilion method and 
holding intolligoncc constant, the coiielalKm between study lime and 
scholastic standing is -I-.332 ± 05 

From these coefiicienla it would wem Ihut tho intelligence' lest was a 
better mdicalor of scliolaslic success (hiui sUidy tune. Intelligence is 
not definitely related to study lime .since llie .student with n liigh or 
low score is as liirely ns not to study n long or short poiiod of time. 
This la illustrated by refiu’euco (o an individual case. Two students 
who Blood at the ninely-eiglitli percentile in the intelligence test studied, 
on tho average, seven nuiiuteH, and four lunus niul luiielecn minutes 
per day respectively. The student wliose study lime was seven 
minutes por day made a 0 average in her courM'H, The (illier student 
had ft straight A average. 


HUMMAin 

An investigation was cained on wilh one hundred Iwonly-sovcn 
teachers college students of fiehliiutm to senior standing to analyze 
the tune factor in study and to relate it to iiilelligenco and scholastic 
standing. The following points of uilovest have, apiieured. 

1. Approximately one-half, foity-four per cent, of the eliulonts’ 
study is cairicd on in the evening by artificial ligbl. 

2. Tuesday lends to be tho day on which the most studying is 
done; Friday ia tho day when the least studying is done 

3. Sunday is a belter study day than edliei Fiiday or Saturday, 
judged m terms of amount of linio devoted. 

L Tho average daily study lime foi the entiie group was one hour 
and fifty-one minutes. When IIkiso who did not study on a given day 
are eliminated this average rises to two liouis and ibirloen minutes 

'Soo May, Mark A,' Ptcrliutitig Aeadciniu Kucpess Joiirnal of JUtlvcalumal 
Psychologv, Vol XIV, 1023, pp 420-440. 
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5. Towards tho end of the week there is a pronounced tendency 
to shorten up on tlie duration of the study periods and a less pronounced 
tendency for fewer students to lie studying. 

6 Sixty-sovcn pei cent of the students studied on Sunday, ninety- 
four per cent on Monday, over nmoty-nine per cent on Tuesday, 
ninety-six per cent on Wednesday, ninety-seven per cent on Thursday, 
seventy-three per cent on Friday, and foity-ono per cent on Saturday 

7. Sixty-threo pei cent of tho students’ study time was given to 
reading textbooks; ninclccn per cent to outside readings; 8 6 per cent to 
working problems; and 9 6 per cent to writing themes and othei 
papers. Eighty-two per cent of tho total time was used in reading 
and eighteen pei cent in writing. 

8 Study tunc correlates -1-.317 ± .06 with scholastic standing, 
intelligence coriolalcs -t-.605 + .04 with scholastic standing; and intelli- 
gence correlates 003 ± 06 with study time. With mtolligonco hold 
constant, study time con elates + 382 ± 06 with scholastic achieve- 
ment. Intelligence appeals to be a better indicator of scholastic 
succesa than study tune 



CONSTANT ClIAN(iKS IN TIIIC STANFORD-BINET IQ 

PSYCllK OAT’J’ICIJ. 


Ilnrvonl Univptwly 

The Harvard irniveiHily (Jrowdi Sliidy, comhicted by Professor 
Waller F. Deuiborn, is now in ih mtilh year JOach year some 
one luindrcd fifty to two thousand of the eliilrlrcn liavc been Riven 
an individual Htwxfoid-Biivot u\teUip,eufe oxiuuvnatiou. By the end 
of the sevcnlh year two or more Ibnct K^'h luui been secured for 
one thousand one hundred eiRlily-lhrei' pupils. Tliesc one thousand 
one hundred eiRiity-lliroc subjeols were divided into groups according 
to the period of tune (bat luul elnp'iOd Ijotweoii the first two 
Binefc examinations: uiulor llirco inonllis (hrec to six months, six 
to twelve, twelve lo ciRhtcen, oirIiIcoii to Iwonty-four, f.wcnty-four to 
thirty-Bix, lhirty-si\ lo fort 5 '-oiRliL, forty-eiglit lo sixty and sixty to 
SGVonty-two ‘ 

The median amount by which Iho second I (i fell short of or exceeded 
the first is sliown in Table I. It appears jnobable lhat the median 


Tahi.b I — Mbdian Binkt IQ CirAhor.H Atrrn ViiniNO I.ntkhvai.s ov Time 


Months Ijotwccii testfl 

No of 

I Mc‘(linii 

PE 

0- 8 

ift 

4 5 0 

il 1 

a- 0. . , 

54 

^h3 S 


0’12, 

30R 

TO 2 

1 to 4 

12-18 

174 

-h2 0 


18-24 

04 

-0 5 


24-30. 

02 

-0 2 

HIH 

30-48. 

203 

-2 7 


48-60 , , 

51 

4-1 0 

±1 5 

60-72 

320 

-’0 1 

±0 4 

0-72 . , 

1383 

02 

±0 22 


gam of fiO points in Iho group rejieating ilie test williin a period of 
three months and of 3,8 when lepoaling it after a poiiod of from three 


‘It wna found that tho effoot of priiulico did not onn v ovn eiKlitonn inoiithai 
theroforo a child that hail been Rivnn Bevorid louts was uhpiI id inoie than oiio coni- 
paiiBon provided that no U'»t had bom Rivon botwmi t ho two Iioiur compared ot 
withm a period of IR monthn prooodiiig llin (irBt. 'I’lns pioociluK' lucronBcd the 
niimhor of compansouB by two Imndrod briiiKUiK llie tolnl u|) to one thousand 
three Iniiulred oighty-threo. 
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to six months icsultcd horn the c\pcncnco gamed during the first 
testing. There, however, appears to bo but little, if any, practice 
effect resulting from a test taken more than six months previous. 
The group of one hundiecl w'Vci\ly-fouv cases mih an interval of 
twelve to eighteen nionthn nnidr ii median gam of 2.0 points, but the 
three hundied eight cases with an interval of G to 12 months showed a 
gain of only 0.2 of a point, fioni eighteen to twenty-four raontlis 
there was a loss of 0 5 of a point 

In an carhci study it was found that at the upper levels of intelh- 
gence certain group testa gave unifoimly higher and others uniformly 
lower IQ’s than the fitanfoid-Bmet ‘ The question aiisea as to 
whether this was caused by vauations lu the standaids of one or both 
tests, by factois inherent in tho lest items, or smeo the group and 
individual tests were not always given in the same yeai, whether there 
was a real change in llie lolativo inlclhgcncc level of tho child, 

When coinpaiing the gains and loses of Stanford-Binet IQ’a of 
bright and dull children, Oarusoii wuics* 

Since there doea RPcm to be a slight gam m tho higher classca, it is evident that 
there le a slight piaotiae clTrcl, that tho toat is relatively casieT in the higher ages, 
or that tho IQ actually inoicnHes for the higher elasBca We fed that there are not 
enough data available yet to warrant <ldimte oonchiBions ^ 

Bugg and Carlton state that. 

DiGorcncra m lOtcHtfl will be approximately thoaainc, nieapertivi' of intolhgenee 
of tho pupiL* 

And Term an that 

* , the IQ renniins almost (spiallv constant for tho three groups The 
greatest tendenoy to gain appeals with tlio avciagc gioiip and the next greatest 
with the dull Tho (lifTeicncc'fi, howiwoi aio practically negligible It makes 
little (lifTcrencc whether the oluld was blight, average, or dull, how long an inter- 
val separated tests oi what the age of the child was at the earlier tost ^ 

Each Limc-inUii val gioiip was ledividcd into tluee IQ levels accord" 
mg to the avemgo of tho Bind IQ’s below ninety, ninety to one 

^ Cattell, rflychc" Conipai ability of IQ’s Obtained from Different Te>st3 at 
DiITcront IQ Lovcls School find Socicti/f March 20, 1930 

^ Ciftrrjflon, G S Additioiuil Retests by means of tlie iStiiiiford lloviHion of the 
Bmot-Siinon Ti^sts ./amiud Bducnliojud Pui/chologgf May, 1922, p, 311 

UUigg, Iliuold and Cot lie ColloLon Constancy of tho Btanfoid'Biuet IQ aB 
Shown by IleleHls Journal fCdncalionul I\Hychologifj Sept , 1921, p 320 

^Tcrman, Lewis M ^‘The Intelligence of School Cliildion " Houghton 
MifUin Co , 1910, p]3 MO and HO 
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hundred nine, one hutulied len luul higher. 'I'lie median of the 
diffcrcncofl of each Rroup are plolled in Iur 1 Tlio first bar of each 
group represcnlB lliow with IQ’h below nitielj’, Ibo second those with 
IQ's from ninety to one hundrcil nine and third those of one hundred 
ten and above Tfie ainmint l»y which llie iticdmn child's second 
IQ fell short of or exceeded the Iirst is given on the vertical scale, 
For example, in the Hccoinl gionp in which the time between the two 
tests varied from six to twelve inorithH, thi' median pupil with an IQ 
below ninety lost 1.4 poiiils, the niediun of those of average ability 
gained 0.1 of a [loint and the itieilnui of llioho with KJ’s of one hundred 



Fta. l — ModiRU ohanKCR lu Uio Huiot I(i of dull (ivutuno luul lirlaUl imiiila nftar vwy- 

ihK inlorvitiH of linio» 


ten or hifihci* Rained 0.2, Tho Bain(‘ daln are rivoii in tabular foriu 
at the foot of llio chart, the first row riy(‘,s t he median of tlic dilTcrciices, 
the BGcond the number of cUvSgh nnd Ilia lliud llio liino interval between 
tho two tests 

When the testa ware repealed after an intcival of less tlian six 
months tho median IQ of the pupils at all Ihieo IovcIh of intelligence 
showed a gain, probably duo, ns Htalod ubovo, lo the offccl of piactice. 
The average group gained slightly luoie Ilian oilliai the bright or dull 
group, but the difTcrcnccs aic loo small lo be of .significance. Ab the 
time interval bolwcoii tho tcHts is iiicreiiMul iieyond eighteen months a 
tendency for the low IQ's to dociau.sa and the high [Q’s to incicase 
becomes ovidonl.^ The further apart the two ((‘sls the more marked 

^ Whon a olnld paeaed a total of five or nioio IrslH ni ynirw Hivleen and oiRhtcen, 
Professor Torman^e corrcolion wiib appliod to Uie monlnl ago ((Jonctie i^tudics of 
Gemua* Voh I, p, 42.) Since only a few of the rliildreii wcio ovci fourteen ^eeraof 
ago at tho time of the last lest, the inajniity Ijoing uinhu tlinteon, tlie eoircction 
was needed in only n small proportion of the cases 
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is the tendency. When the last two groups are combined it is found 
that the median loss of the eiglity-one cases with IQ’s of below ninety 
was four points wliilc the sixty-onc eases with IQ’s of one hundred 
ten or higher gained seven points The median change of those of 
average intelligence was only one-half of one point. 

The tendency for (he low IQ’s to lose and the high IQ’s to gain is 
sliown oven more clcnily in Fig 2. All these cases in which the interval 



Fia 2 — Mediivn BinoL IQ ohtingos at dirfcroiit intoHigonco levels 


bctwcon the two Siantord-Biiirfc tobta was ovev thicc years were 
placed in one Kroup unci those with an mleival of under two years 
in another Within each Rioup the subjects woie divided into ten 
point IQ gioups, leaving those below seventy in one group and those 
above one hunched forty in another The medians of the differences 
between the first and second IQ of the pupils icpeating the lest after a 
period of from lluoe to mx ycais me lepiesontod by solid bars connected 
by a solid line. The (endoncy for the low IQ to become lower and 
the high IQ to become higlioi m iiuiikccl The lowest group lost 7 6 
points, the higlmst giiiiu'd 10 0, while the medians of the changes of 
the reiniiining gioups rangc^cl between these two extremes 

The rneduLii of the chiTcrenccs between the first and second IQ 
of tlic groups taking the two tests at intcivala under two years gives a 
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differont, piclnir. Thoy me ropiOHeutcd ni sliatled Ixus connected 
by a broken lino in b'lg. 2 No kiou|) hnd u inediun change of more 
than 1.5 poinlH with the cveeplion of llie gioup below Hi\ly IQ and the 
one above one hundred foi'ly. Theie are lucdudcnl w'veuty-two that 
took the two tests within a period of aiv iiioiilliH The effect of 
practice earned over to the hccoiid le.s(. in llit'se ciihes is probably 
sufllcicnl to account for (he excess of sinall gams over losses in the 
interincdiato gumpa The loweal gioup only eoutiuiiH olcvcn cases 
and llic gains of foui points may widl he due (o clmnco eirors. The 
gain of nearly nin(‘ ponit.s in the group of eighteen cases with IQ's 
of one huiuhed foity and above is not so easy to explain, it may also 
be due, at least in pait, to clniuee mois, or it may be that the effect 
of practice is cairied ovm a longer iieriod m (lie ea.so of exceptionally 
bright clnldren lliaii it is among other ehiUlreii (only three of the 
cighlpon cases weic releKieil within a peiiod of less limn six monthb). 
Finally it is possililo, though it doea not Heein probable, that thciolative 
mlclligcnce level of llie gioup was aetuiilly lamed dining the short time 
between Iho tests. Moio limn one fiietor is inobaljly involved. 

Theic is, of couibc, a possibility lluiL some of I he changes in IQ 
ai c caused by variations in llie teHter.s Vifty-scveu diffeicnt exanuneis 
look part m the testing. All wen* insliuetois, assi.slanls or graduate 
sludonta m psychology or education at Harvard Umveieity. How- 
ever, tho geneml trend of (he cuives is too jcgular to be explained 
away by chance errois in the sample or by the peisonal eciuaUon of 
the examiners, it is more likely that sucii eriois aie responsible for the 
iriegularitio.s ni tho general trend. 

'I'he cause of tho gain of llic high IQ's and the loss of the low is 
not clear The factor of praoiice is ruled out by the fact that tho 
greater the time interval between the tests, the giealcr the gam of 
the bright pupils, and the fact that the piipiln of low intclhgcncc lost. 
The gain in the liigh IQ’s would he accounted foi if tlio upper testa 
on tho Bmet scale xvcio too easy, but the revenso ha.s generally been 
supposed to be true and, in any ca.se, tins would not explain the loss 
of tlie low IQ's. It may be that the lirighl cliild has, or finds, more 
opporluiuLics to aoquiio lliat type of jnformulion wliieli aids m success- 
fully pafising tho Binet tests than the oldm- chihl of the same mental 
ago. The greater interest in leading of Hie bright cliild and the lesser 
interest of tlic dull child may bo a factor. 

If there is a tendency for the range m IQ’s to incicaso with age it 
would be Buf&cicnt to account for the median increase of llie high IQ’s 



Comiant Changes in UtanSord-Ihnet IQ 


649 


and the decrease of the low IQ*8. This flcoms to the writer the more 
probable explanation It is, of course, well known that the lange of 
the distributions of heights and wciglits of children mcicase as the 
age incieases, also mtolhgencc when ineasiucd in terms of mental age. 
Tlie theory of llio constancy of the IQ is based on the assumption that 
though the intelligence of the bright child mcieascs at a greater rate 
than the dull clnld, iliai of l)olh the blight and ilic dull child remain 
constant m propoilion to his chronological age. A child that has 
a mental ago 20 per cent above liia chronological age at school entrance 
would maintain the same propoilional difference between his CA 
and MA throughout the period of growth Although the difference 
between his mental and physical ago would increase, his IQ would 
remain constant. 

The present findings indicate that those pupils that start school 
with IQ^s above the avoiage, not only incicasc m mental ability at a 
rate sufficient to keep the proportion between the life and mental age 
the same, but at a moic rapid rate, causing the IQ to rise, while the 
dull child^s mental ago falls lelalivcly to his CA, causing a drop in 
the IQ This is contrary to the findings of Terman and of Rugg and 
Carlton quoted above but is corroborated by Garrison who finds a 
slight increase in the highei classes and with Cyril Buifc, Doll and others 
who have found a decrease in the IQ of sub-normal children and with 
Kuhlmann who writes that. 

It hug been knami for some tinio that the TQ as found by testa that give 
correct mental agos at all mental levols (loos not remam constant throughout suc- 
cessive* years, except for cltildren with an initial IQ of 1 00 Initial intelligence 
quotients below 1.00 lend to decrease, and above 1 00 they tend to mcreaso as the 
child grows older ' 

Freeman in lefening to sub-noimal childien makes the opposite 
statement’ 

Wo may expect backward chiidioii to gam about aa much from ym to year 
and to contimiQ to gain about as long ns normal oluldron or bright children,'* 

This would mean a maiked increase in IQ of the backward children 
as age increases. It appears, howevei, from other statements made 
by Freeman that this la a slip of the pen and that what ho had intended 

' Kuhlmann, F, and lloso AndoiHon ^*The Forthcoming Kcvision of the Manual 
of Instruction for tlio ICuiUmann- Anderson IntcUigenco Testa The Educational 
Teat Bureau, Mimicapolia, Minn , p 118. 

» Freeman, I^ank N", Mental Tests Houghton Mifllm, p 357 
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to write wan iiioliubly that the iliill cliild contiiuiPd to grow as steadily 
iiiul for ns lonjt n Imie us the nonnul and biiKbi child, hut at a slower 
ittte. If (Ins i)o tlu! conccL int(‘r])ictiilion he is m iiHrecmcnt with 
the view liold by Tenmm iind hi« followers 

( 'OMlMWIONN 

1. When ii Htunford-Hiiiel- lent is reiieiiled williin a iieriod of three 
or four luontlia the expi'iieiice niinied while lakiiiK the, lust test appeals 
to lesult in 11 - median kuiii of four or live pomis in the second IQ 
No siRnilicanl difference ni amount of niun made by brij'ht, average 
or dull cluldieii was found Tlie practice elTcct ciiiricd beyond six 
months appears to be iiibiKinlicuiit. 

2. A deiimlc tendency waa found for the pupila of high intelligence 
to gain nnd for tliOHO of low itileUigence to lose in IQ ns they become 
older. 



SOME EELATIONSHIPS BETWEEN ALGEBRA AND 

GEOMETRY 

DOllRIH MAY LEE 
(ilondiilo City (Schools, Glcndalo, Calif 

AND 

J MURRAY LEE 
Director of Iloscarch, Burbank, Calif 

1 . What 18 the relationship between ability in algebra and geome- 
try? 

2 . What 18 the iclationship between achievement in algebra and 
geometry? 

3 . What percentngog of pupils show differences between algebra 
and geometry, in respect to ability and aclnovement? 

4 . Arc the students who continue with geometry a more select 
group than all the pupils who took algebra? 

5 . Do students tend to get bcttci oi poorer giadea m geometry 
than in algebra? 

An attempt will be made to answer the above questions using 
data made available from two piovious studies Since these studios 
wore conducted a year apart, and two of the schools wore used in both 
studies, thcio were complete rccouls in both algobia and geometry 
of one bundled cighty-ono pupils These records consist of scoies 
on the Lee Test of Algebraic Ability* and the Leo Test of Geometiio 
Aptitude® given before Lho pupils had begun the study of the respective 
subjects, scores on an nlgelnaic achievement test® and on the Renfrew 
Geometry Teat* given at the end of the fiist semester of each subject, 
and tho fiist semester's miuk in both algebra and geomotiy 

There has not boon an attempt to follow-up each case that took 
algebra. 'I’hcrc was loss through fniluies, drop-outs, and moving 
Whether tho pupils that moved would be selected fiom tho upper oi 
lower ranges of ability is not known, but the writers have assumed that 
the factoi of moving has not caused a distortion of tho data 

' Piildmlic'd l)y Piihlin Hcliool PuldiHhmg Co, BloomiiiBloii, III , IDSO 

’PiibliBlird by (HouUxmii Cnliromia ,Si)hool Book Dcponitoiy, Los Angolcs, Calif , 
1031 

* A non-Hlaiidauli/od tost of (10 itciiiH 

* Piihlialml by C A Giogoiy Co , Cincmiiati, Ohio 

61)1 
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What la Ihe u'kUmiylnf) htirimi uhihlij m ahjihra and in geometrui 
There ir oiio published Hludy, A J/ Heifers/ that funnslics data tluit 
ie comparable with the data in the p^‘^<out nLudy J)r UoRcra found 
the correlation boLwern alf^elmuo and ^(’ometno ability to bo .52 for 
one Hcliool and fm anotlu'r with an av<»ra^(* oorrolution of 47 ± .03 
When thin averap;e was roinadiMl for al lealualion it became .54 ± .02 
Corrolallnim ^seie found Indwren llu^ I.im* T'chI of Algebraic Ability 
and the Leo Tost of (leometnc Aptitude for I lie one hiiiuhod oighLy-one 
pupilb whose complete records weie uvaduble ThoBC correlations 
with (ho corrections for ai tenualuiii are given in Tulile L 


TADLfi I — Tnn C'()niu:ii\jin*r iiljwm.n Aiiiiit\ in Au»LitHA and Adility in 
C iTOMF/rin AS .Shown u\ 'uin <)oiUiHt\TioN iimwkon 'ihb Lkk Teat op 
AL nnriJiAic Aiiii.n'i ANt» thk Ttsr oe IlKOMF/rnie AniTupH 
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r(TAA)(T.GA) 
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’ 55 1 

Ui 
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j r»7 ' 

07 
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1 Kolloy, Trurufin L , 'NSliilifllirfil Method ” New York Maeiiullan Co , 1023, 
p. 20 i, Komiiila 155 » 

» m ’ p 2m, Vmmuhi m 


Ifroin iho resullH of these two Htudies the coneluHinn can be drawn 
that the correlation between ubilHy U) do ulgebui and ability to do 
geometry probably lies between 50 fuul .()5 

What ih the iclaliomhip hdiiiccu ac/ttcre»icfd in ahjdna aad achieve- 
mcnl 171 geojmliy? iVloHt of the Htudies in ibiB field have donll witli 
school niarka The coiroliilioii between tlio final mark in algebra and 
tho final mark in geometry has been found These studies areaum- 
marized in Table II 

In the present study there arc two measures of achievement, the 
marks for the first scmostci of algcbin and geomotiy and the scores 
on achievement tests given at llie end of tlio lust scineslei of the 
rGspoctivo subjects These coirelalioiis uk* pivsentocl in Table IIL 
It IB inter osling to note that in neither school is the con elation 
OS higli between achiovcment t(‘HtH as it is Ik'Iwi’cui lunikK, Tins vjould 

1 IloRorH, A L.: K^cpenmnnlal of Matlieniatical Ahihty and Thoir 

Prognoalic Vnliic, Teackc}8 College (*() 7 itnlfidion^ (a JCdurfitwn, iVo 80 Now 
Yovk Tmhcifl GoUege, GoUimhm Uwwi'rhay, UILH, pp 





lielalioiishtps heiwccn Algebra and Geometiy 663 

Beem to indicate an addtUonal factoi , separate from achievement, that is 
influmcing the murks 

From a atudy of Tables II and III, the corielation between achieve- 
ment in algebra and geometry probably lies between 40 and 70. 


TaIILH II,— CoUHBLATIONB liJ.TWKON AcmnvnMENT IN Algebiia and Achibve- 
mbnt in Gi 30 mi:tk\, ah MnAHuuno nv Tbaciihrs* Mabkb, from Previous 

Studies 


Authoi 

No of cases ^ 

Correlations 

Burns ^ 

IG schools 

67 

Crathorno® 

1900 (approx ) 

62 ± 02 

Wmegardaor® 

417 

609 ± 024 


» Burrifl, W P , Correia Lions of the Abilities Involved in Secondary School 
Work, Edited by E I* Tliorndiko Colxmlna Umvemly Contribulions to Edxi^ 
lalvnii Vol, XI, No 2, 1003 

^Crathorno, A. K '*Tbr Theory of Conolation Applied to Scliool Grades/' 
The Ileorgniiizaiioii of Mnthoinutics m Secondary Educntion, Chap X The 
Mathematical AHBoeiation of Amonen, 1923 

^ Wincgardner, J IT Tlio Uelation of Success in Mathematics to Success m 
Physics and Chemistry iii Higii School Unjmhhshed Master^a ihms, Department 
of Education, Stanford Univorsity, 1920 

This fact and Talilo I Icndw to allow that the conolation between 
ability in algebra and geometry is usually higher than that of achieve- 
ment, and further, that the eoiiclations between ability are more 
consiatent than those between iichiovcirient 


TaRLTI in — CORUlUiATlONB DETWMKN ACHIEVEMENT IN ALaEQRA AND ACUIBVE- 
MENTIN GKOMETin, AH MUAHURED RY TEACnERS’ MaRKS AND ACHIEVEMENT 

Tebth 




j r between marks 

r between tests 

School A 

i 130 

474 X 044 

410 ± 048 

School B 

40 

709 1 060 

606 i 069 


What percentages of pupils show dif)erences between algebra and 
geotneiry, in icspcct to ability and achievement? An attempt to answer 
this question is anotliei means of attacking the pioblein of the relation- 
ship between these two Hubjects The method of finding such differ- 
ences as called for by tlie question has lioen determined by Kelley ^ 

‘ Kelley, Triiiimii L * A Now Molhod foi DcLerniiniug the Significance of 
DilTerGucea in Iiitolligcnei‘ and Achievement Scoics Journal of Educational 
Psychology j Vol XIV, September, 1923 
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The method used is to hnd the value of then by referring to 

Table IV in Kellcy’H article, change (hia ratio to a percentage. This 
then gives tlie percentage of pujiila that show differcnceB between 
algebra and geometry that are more frcf|ncnt than the chance factors 
in tho meoHurca would produce. 

The data and formulae which are needed m thus evaluation are as 
follows: 

irj.u « V 2 -- In r,„ (ace Kelley*) 

and 

ffd \/l - 2rij 


TAunw IV. — REUiAiiium Cokh'icibnth or tub VAuioim Tusth Waicii Wehb 

Uhbi) 


llELlAnlLlTT 

TfflrTfl ('oBmciBNTa 

TcBt of Algrbraio Ahililj^ 93 

Teafc of Cicomctnc Aptiludr 91 

Algebra Achicvnincnt*lV8l ,96 

Geometry AcluovcinontToHt 85 


The other correlation cocfliclonts nccde<| aro found in Tables I and III. 

The percentage of difforoiiccs in individual test scores, as shown 
by the application of the above (ormuhn and Tniilo IV (Kelley*) 
between algebra niul geometry m respect to iiclue,veniont is forty-one 
per cent for School A and thirty-four per cent for School K and in 
respect to ability is forty per cent for School A and thirly-nmo per 
cent for School B, This indicates that there is about ns laigc a 
percentage of diftoronce.s found between aohicvcinent and also ability 
tests m algebia and geometry as there is liotwccn such tests in the 
Stanford Achievement Battoiy, as AriLhmctio C'.omputation and Para- 
graph Meaning.* 

Using tho same technique, differences between the marks in algebra 
and in geometry wore determined. Using .70 us a reliability cocflicicnt 
for marks and the coriclations between murks as given in Table III, 
the differences were found to be thirteen per cent and 'Aoi o tier cent. If 
higher loliabihtics of maiks hud been assumed these difTercnccs would 
have been laigor, if however, a lower coelllcient hud been used the 
difforenccs would Imvo boon oven less, 'riicsc diffcionccs seem to 
further mdioatc there is another factor entering into the marks in 


1 /bid. 
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both algebra and geometry than those that can be accounted for by 
achievement or ability. 

Are the students xoho take geometry a more select group than those 
who take algebraf In anewoiniK this question three sets of data will 
be Borutinizccl. These arc the algebra marks, algebra achievement 
scores, and the bcoiph on the Lee Test of Algebraic Ability. The 
records of those pupils for whom both algebra and geometry scores arc 
available will bo compared with the algebra record.? of all the pupils, 
Fuat, the algebia marks of the pupils continuing with geometry 
are compaicd to the algebra marks given to the whole group These 
facts are given in Table V. 


Taulb V. — A CoMPAiuBON or tub Makks IIkcbivbd in Fikst Semester ALaEniu 
nr Those Pupii-s Continuing in Gbombtui, with Tiiosb Hcoeivbd by Ar,i, 

Pupils 


Algebra marks 

1 

Number rcci 

^1) 

[‘iving eaoh mark 

Continuing 

Percenlago of 
pupils coiitimiing 

A 

34 

27 

79 4 

li 

126 

86 

68 0 

C 

162 

05 

42 8 

D 

12 

3 

26 0 

F 

71 

1 

1 4 

Total 

394 

181 

46 9 


In studying Tnlilo V, the fact that pupils may have moved, or 
postponed taking algebra should be consideiod The last column 
shows that 79 4 per cent of tlie piipiis who received "A'’b in algebra 
continued with geometry Fiom this it drops to 68 0 per cent of the 
continuing For the “C”b it drops to 42 8 pei cent then to 
26 per cent of the “i)”s and to 1.4 per cent of the “F”s or failuies 
It is obvious that a much gi eater percentage of tlie pupils icceivmg 
“A’'s and “5”8 continue Ihaii do those icceivmg “C’s and “D”b 
Most students icceiving “D”h and '‘F"a m algebra consider that 
tlioy have had all the expoiience with mathematics couiscs that 
they intend to have and tlu'roforc do not Lake geometry 

Tills condition would seem to nuheato that thcio is a need for careful 
guidance of the pupils ivlio are to lalco algebra and the piovision of 
some olhci course in mathematics for those pupils who will probably 
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fftil or receive “1)”h. 'I'liis roiiiKC filujiild be mueh easier and cover a 
much broader uialhniiiilK’al field than Die legulur algebra course 
Hecond, the acliievoimuit .scores of all pupils are compared with 
those of the puinls who eoiiliiiue with geometry 'I'he records of the 
two groupH are given in Table VI 


Table VI — A (Iomi’miihov oe tiil Hcoio s Hi envLii on an Au.i iiuaic Aciuevk 
MENT 'IVhl' (ilVlN AT 'lilt. KM» (U- 11IK ImIIST Hr All, THE Pums 

wiTit Tiiom, or mr, I’eisi.s tViio (NistiMitH wira IIkowvphy 
Ai i, V\ I'u * < (iHtiNUiua I’upiis 

Ml ‘25 U UO 32 


ffi 


U 20 
10 


<Tt 

- 

N - 


fiS 

50 


m 


It can be fccen from im inspoclioii of Tublo VI I lint (ho mean scoic 
of Ihc continuin^^ f^roup is !! SK points Infj^licr timn (he moan made by 
all the piipiln Dnca tins indicate lhal llioio is a inal difTeioncc between 
these two Kroups or ih it niMcly a (hff(‘iciK'o that nii^ht be caused by 
chance? Tins quchtion can be annworcMl hy IukIiuk (he ratio of the 
ohRorved chffeieneo to (ho Htaivdard devnvlioii of that diffcrmc 

If ifuH ndui iH over llnee, it is fairly coituin that there la 

an uctvml difference, not a ehnneo d\f\eiei\ee The fonnula used to 
find the sigma of I ho (liffcrencea of (lie inenns ih: 

cr,nf « -h (Tu/ — 



whore jh the a of llio mean of all pupils (see Table VI) 
and cTj/i iH the a of the moan of (he con (inning pupils. 

In evaluating (ho above forimila if r is given ii value of the trdu 

value will be n inavinium and --- is a miniinuin 

Evaluating 


hence 


o'cOf ^ *V'l and iif 2 — A7i = Jf 88, 


M2 - Ml 

o'th/ 




Since the ratio of tho obHorved (hlTorenco to the HLaiulaid deviation 
of that difference ia rn3f), it ia ccilaiii that (ho difToiouce is real as far 
as achievement in algebra 13 concernod ami that tho puiiila continuing 
with geometry were superior in ftchicYcmeiit to tho group as a whole 
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Thud, the scores of all the pupils on the Lee Test of Algebraic 
Ability arc compared with those of the pupils continuing with geom- 
etry The sarno method of comparison is used for the ability scores 
as IS used for the uchifivameiil seoios. The lecoids of the two groups 
on the ability test nio given in Table VII. 


TAHLH VII.— a COMI’AHIHON OF TUU ScOllKK llcCniVDD ON TUB LEM TeST OF 
Ai.ai.BnAio Aiiii.iTi jiy Tkohb 1 ’ui*ii/S Continuino in {jKOMETitY with 
Tiiosn or Ai.i. Pupils 


AlIj PlJPlIiH 

jif, = 81 03 

(Tl = 2*1 ()3 

<rv. = 1 2‘1 

N = 39i 


CONTINUIKO PdPILB 

M2 - 02 0*1 

era 21 81 
o'Afa — 1 62 

N = 181 


lit can bo aeon from 'J'ablo VH, that tho mean score of the group that 
continued with geometry is 11 32 points higher than the mean of all 
the pupils, ICvaluating Uus difference — 

Assuming i = Oj then a^tM = 2 04., and = 5.55, 

Since this ratio is equal to 5 55 it is certain that tho difference was 
real aa fai as ability to do algebra, as measured by the Lee Test of 
Algebraic Ability is concerned and that pupils continuing with geom- 
etry wore Bupcrloi in algol)riuc ability to the group as a whole. 

The tiircc? sots of data, nmilcs and achicvomcnfc recoid in first 
Bomeatcr algebra and tlie scoi’cs on the ability test all tend to prove 
that the group that continued with geometry wcic a select group as 
compared with the total gioup that look algebra, The poorer stu- 
dents, acadciniciilly aiicakiiig, do not continue with their mathematics. 
If by caioful educational guidance we would place tho pupil where he 
belonged in the first place, nisloiid of lotting him find it by trial and 
erior, whnt a large anioiint of tunc, money, and discouiagement could 
be saved 

Do studenta tend la {jet belle) or jiooie) giades tn geometry than in 
algchraf One moans of nnsweiing this question is from an inspection 
of tho scattergrains between marks in algcbia and in gcoinotiy 

Chart 1 shown that pupils tended to get poorer grades in geometry 
more often than they got better ones as compaicd with their grade m 
algebra. 

It is interesting to nolo that only one pupil raise<l his mark as much 
ae two points Tins pupil in School A received a C in algebra and an 
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A in geoinctiy. Ilia iibilil.y tPi>l in alRobrn sliowcd ho was quite low 
but in geometry bin nliilily ficoio wont up (o tlio 7 . 1 lli percentile of tho 
group Ilia achiovontonl. loath ugrood with the uiiirks, in foot, nil 
rccordu indicateil tliiit lie was only low average m algolira and superior 
in geoirieliy. Ho la the host OMiinplo of marked dilToroncps favoring 
geometry lluil la in tlio Htiidy. 

Ghaut 1 — A Comoauimin iiKrwhKN Maukh llhohivun in (>h)mktiiy with 

TlKtUl/UhOKlVKl) IN Al.dWtllA 

Kcliool A adittol It 

Itcomclry lieoinctry 


F 1) a n A I' DOHA 



Tho figures m bold face lyjio indicate I ho tniinla that icceived the 
same mark in both subjecla Those above lliia diagonal line received a 
lower mark while those below it leceivod a higher mark. In School 
A, fifty pupils lecoivcd the Hamo mark, twenty-six impioved their 
mark while sixty lowered il. This siUudion is to be expected since 
in the case of algebra, these juipils wcie a aeloct group in the upper 
ranges, but m geometry those same einses woie r<>dislribulcd over a 
normal distribution. It would then be expected that the chances 
for a pupil to got a lower mark m gooinetiy aie greater than his 
chances to got a higher inaik In School A, tins chance of getting a 
lower mark was n little ovei two to one, wliile in School B it was nearly 
ton to one 

Another comparison between idgelira and gi'omolry (hat is worth 
noting is the diUcrcnces in the percoidugo of each mark given. Taking 
the two school systems that worn used in both sl-iubcH, iiciccn luges of 
each mark given arc coinpnied in Table Vllb 

There is a slightly grealoi per coni of "d”8 given In geometry, 
however the outstanding difference is in the ])crconlago of “jD”8 
This might bo nccouiilcd for by the. fact that nlgebia is much moic 
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definite and the failing point can be determined with more ease than 
in the case of geomotiy. 


TAULH VIII — A CoMPAUlBON OF TIIK NtlMDBU AND PbIIGENTAGB OP EaCII MaUK 
Given in AEGEnnA and Geometry 


Mark 

Algcljra 

Ocomotry 

Number 

1 

Per cent 

Number 

Per cent 

A 

3i 

8 0 


12 2 

B 

126 

31 7 


31.4 

C 

162 

38 0 

00 

28 9 

D 

12 

3 0 

61 

10 3 

F 

71 

18 0 

36 

11.2 

Total 

394 

DO 0 

312 

100 0 


Summary 


Comparisons made bolwecn algebra and geometry using marks, 
achievement test Hcoies, and ability tost scores have led to the following 
conclusions. 

1. The relation between ability to do algebra and ability to do 
geometry as oxpi’cssod by coi relation coefficients, probably lies 
between .50 and 05 

2 The conelation between achievement m algebra and geometry 
probably lies between 40 and .70 

3. The correlations between ability in algebra and geometry arc 
usually higher and moio consistent than those of achievement. 

4, About 40 per cent of the pupils show differences between algebra 
and geometry in respect to both ability and achievement that can not 
be attributed to chance 

5 Some factor other than ability and achievement is entering 
into school marks in these two subjects 

6 Studenl.s who take gcoineliy arc a select part of the group that 
took algebra Che year befoie 

7. Pupils loeeivmg low inaiks m algcbia do not ns a rule take 
geometry 

8 Pupils have a greater chance in geometry of getting a mark 
lower, rather than highoi, than they got in algebra. 

9. It seems that it is more difiicuU to dcteiminc the failing point 
for a pupil m geometry than it is in algcbia. 
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The ediicnltonul lUiplicufUHiH of Mi(* iiliove findin^H hccm to be 

1. Hetter KUidance of ii pupil in Rcoinoliy iH poKSiblo by using teats 
of ability to do geoiiu'tiy than by iiMiig Ibe tilgobra record, The two 
however ahoulil bi' iiRod loMelluTr 

2. More careful eilucalionat guidance hIiouIcI be, given pupils who 
arc ready Lo enroll iii algebra, and (lie probable failiireHebminaLcil. A 
course should lie provideil for Ibe^.e pupils wlnob is imioli easier and 
covers us broad a iiinlheniatieal liehl us poi'.'>ible 

3. Marka slimibl be given on the Vuihih of achiovenicnl. In order 
to oliiniiuite other factors whieh aic* now diU eruiiiinig tlic mark, such 
objective laeusMics of acbicvenuMit. as ar<' now obtuiaable, should be 
used. These objeclivo Ip.sts should he given seveial tiinca throughout 
the seioestei to give us many inensures us is possible 
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SCHOOL ACHIEVEMENT IN DELATION TO MENTAL 
AGE-A COMPARATIVE STUDY* 

ANDREW W BROWN AND CHRISTINE LIND 
Inatitnlo for Juvenilo Research (Chicago, lil.) 

I. Statement op Problem 

It 18 fairly well established that in the regular public school where 
the children arc of average intelligence, the achievement of those with 
intelligenee quotients below one hundred is, in gencial, above that 
which would be expected of their mental age, while the achievement 
of the childien with intelligence quotients above one hundred is likely 
to bo below their mental ago and the further the intelligence quotient 
is below or above one hundred the greater the discrepancy between 
the mental age and achievement. In other words, the accomplish- 
ment ratio (All) which is the ratio between the educational age and 
the mental age correlates negatively with the intelligence quotient. 
This is the case in the public school where the majority of the children 
are of average intelligence. 

But is it a general characlcristic of all dull children that their 
aohicvomcnL be above their mental age and of all bright ones that 
their achievement be below their mental age, or is this only lelative 
to the group m which the children happen to be placed? To be more 
specific. It is known that childicn m the legular public school with 
intelligence quotients from seventy to ninety, have, in general, achieve- 
ment ratings above their mental age, but if these same children were 
in a group where they weio relatively biight, would their achievement 
ratings still bo above thoir mental age or would it fall below? Is the 
difforoiico between the mental ago and achievement ago the same 
for each school subject or do some subjects show a greater 
vaiiation than others? And again, at what level of intelligence is 


* Studios fioin tho Instituto for Juvenile Research, Chicago, Sorles C, 106. 
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the variation the nfcwtCBl? It ia tlioae prohloiiis that this study 
attcinplB to invoBliRaU'. 

II. MKnion OK Stiuiv 

Two groups of childri'ii were wlccli'd for hludy, ono group from the 
academic doparlnirnt of (lie Linrolii Slate School for the fceblc- 
inmck'fl and one from the (ilonwood Manual Tnurmig School. 

At lancoln only Ihoia' ehiklren are adinitled to the ivcaiicmiQ 
(Icparlment who have intf-lligeiiee (niolienlH above 50. Thcic were 
four hundred children in the ncndeniic di'parlment but only those 
above grade two wore iifcod for this study. Shoitly after the children 
are committed to the insUtulion, they are given the Stanford-Binet 
ovamiuation by the reHidmit psychologist. It lu the mental ago and 
intolhgcnco quotient Kccured by tins exiuniiialion Ihiib is used hero. 
If the menial age luid boon M'cuied more thnu n month jnior to the 
timo of the sludy, it was brought up to dale by multiplying the 
mtclligcncft quotient by tlie pri'sent cliionologiotd age. 

Glonwood 18 a private school for deiienclenl boys. 'I'liere ia no 
selcclivo factor oilier lliiin depeiuleney in the Hclcetion of the sludentB. 
The aveiagc intelligence ruling of the eidire school population is 
around .95. The, mental age ami mlelligonec tinolienl used in this 
study were secured from the Ilnggerly Intelligence iCxamination 
Della 2. 

The children of both groups weuj given the following tests of the 
Stanfotcl-Acbiovcmcnt Senes; 

1, Paragraph Heading. 

2 Word Reading 

3. Arithmotio Reasoning. 

4, Arithmetic Computation. 

6, Spelling. 

In addition to the above, samplcK of wilting wcie secured fiom 
the Lincoln Group and ucored according to the 'riioiiulike Writing 
Scale. One hundred twcnly-Iivo of this groii)) weie given the Good- 
cnougli Drawing Test.’ 


'Tormnn, L M,, (t. M. llucli, niul T. I,. Kelley ''Mmuiiil of Directions for 
BVanford'Acluovoinent'l'eslfl.'' World Dnok ('oii)|)niiy 

* Goodcnoiigli, Plorciicc: " Mensureinent of Intellineneo liy Drawings '* World 
Book Ckimpany, 
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All of these tests except writing have been standardized for various 
age levels, and if there were a peifect relation, (assuming the tests 
are equally well standardized) these age levels for the various abilities 
should presumably be the same Therefore, the amount of difference 
between the achievement ages and the mental age is a measure of the 
degicc of lelationship 

III. Phesewtatiok op Data 

(A) Relaided Group (l/mcoln ). — Table I shows the difference for 
the Lincoln group between the mental age and the ages achieved on 
the other tests for the throe levels of intelligence — fifty to fifty-nine IQ, 
sixty to sixty-nine IQ, seventy to seventy-nine IQ, for each of the 
different subjects* Reading paragraphs (RP), reading words (RW), 
arithmetic reasoning (AR), arithmetic computation (AC), spelling 
(Sp), writing (Wr), and drawing (Dr). The table shows that m 
reading paragraphs, the sixty-five children from fifty to fifty-nine IQ 
made a total of five hundred fifty-seven months above their mental 
age, and two hundred twenty-nine below their mental age. The 
average algebraic difference [(567-229) t- 65)) of 5 04 months indicates 
a tendency for this gioup, in general, to make a rating higher than their 
mental age in this subject. The eighty-two childi en with IQ’s between 
sixty and sixty-nme make a total of five hundred eighty months 
above their mental age and four hundred ninety-seven months 
below their mental age On the average, they are l.Ol months above 
their mental age m reading paragraphs. The thirty-six children 
with IQ’s fiom seventy to seventy-nme make a total of ninety-four 
months above and three hundred thirty-two months below their 
mental age, with an average of 11.5 months below their mental age 
The differences between the mental age and the educational ago for 
each of the other subjects are read m the same way The significant 
facts of this table are presented in Fig 1 

Figure 1 shows the variation from the mental age of the various 
abilities at the different levels of intelligence. The mental age is the 
standard from which the variation is measured and is indicated by 
the zeio lino. The difference in months between the mental ago 
and the ages m the different subjects is represented on the horizontal 
axis. For example. The children with IQ’s from fifty to fifty-mne 
aic, on the avciage, 5 04 months higher in paiagraph loading (RP) 
than then mental age The childicn with IQ’s fiom sixty to sixty-nine 
aie 1.01 months higher, and those with IQ’s from seventy to seventy- 
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nine are, on the average, 6.61 months below their mental age in this 
subject. 

Tables II, III, and IV give the distribution of the differences in 
months between the mental ages and the achievement ages in each of 
the school subjects for each level of intelligence Most of the cases 
in the fifty to fifty-nine IQ gioup he within a range from positive 
forty months to negative foity months. Drawing shows the gieatest 
variation. 



Fici. 1 — Lincoln Group showing the differences m months between the mental 
ago ana the achievement ages 

In the sixty to sixty-nine IQ group most of the eases he within a 
range from positive thiity months to negative fifty months In this 
group also the achievement m drawing has the widest range extending 
from positive seventy-five months to negative sixty-five months 
These two groups have a range of about eighty months. The seventy 
to seventy-nine IQ group has a smaller range, most of the cases lying 
between positive twenty months and negative forty months, or a lange 
of sixty months. These tables show that the range of the cases for 
each subject m the three groups is about the same, In each of the 
gioups, drawing has the widest range. Since all of the langos are 
about the same, the distribution of the cases seems to show that each 
group has about the same scatter and that the significant facts lie 
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in the clmnge of the average algebraic (IifTen'iice rather Ilian in Iho 
range of cliatribulion. The average algebraic dilTerenccH have, been 
shown in I’lg 1. 


Taulk II — Fim to Fipty-nikb IQ Lihcoi.n fiuoup Skowimi tub DiHTumoTioN 
or DlfFEWBUCBB IH MoUTHB HBTWfcbS MkSTM. Aon ASM A< MlKYRMBa'P AliEI 



Figure 1 shows that, in general, the lower tlio mtclhgenec the 
higher the aohievcinent in relation to the mental age. TIic children 
with IQ’s between fifty to fifty-nine arc doing work decidedly above 
their mental age level m all the subjects except spelling and drawing. 
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Those with IQ’s between sixty and sixty-nmc more nearly approach 
tlioir mental ago m all subjects except spelling and drawing, while 
those wjth lQ*s from seventy to seventy-nine have acliievomeni levels 
decidedly below their mental age in all subjects* 

(B) Average Group (Glenwood) — The Glcnwood Group was selected 
m order to cletcnninc whether the tendency for the brightest ictaidecl 
children to make achievement ratings below that which would be 
expected for their mental age, and the dullest ones to have achicve- 


TadLB III — SiXTV TO »SlXTY-NlNB IQ LINCOLN GrOUP SuoWXNQ THE DiSTIUBtJTION 
OP DiPPRnBNCB IN Months between Mentae Age and Achievement Ages 
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racnt ratiriKS above their menial UKe, i« typical of the rctiutlccl chiklrou, 
or whoihor the same tPucleiicy la prcHcnt in children who aio not 
retarded. 

The Glenwood Rroiip represonls a fairly avcriiRc Rrovip of hoys 
The range of inlolhgouce quotienla was from fifty-five to about one 
hundred forty. The average intelligence (puitient of the entire school 
population is about nincty-five. 
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The group was divided into six IQ levels: seventy-nine and below, 
eighty to eighty-nuie, ninety to ninety-nine, one hnndied to one 
hundred nine, one hundred ten to one hundred nineteen, one hundred 
twenty and above The difleienco between the mental ages and the 
achievement ages foi the vaiious subjects was computed and tabulated 
in the same way as for the Lincoln group. 

Table V prosontB the same data for the Glenwoocl gioiip which 
Table I presents for the Lincoln gioup. This tabic shows that tlio 



twenty-seven children with IQ's of soveiity-mnc and below, made a 
total of one huiidicd thirty-eight months above their mental ago uikI 
eighty-one months below their mental age in reading paragraphs 
The algebraic differenco ((138 — 81) 27) of 2 11 months indicates a 

tendency for this level to make a latiiig higher than their mental ag(“ 
in this subject. The thnty-ono boys with IQ’s from eighty to eighty- 
nino made a total of two hundred fifty-mno months above their mental 
age and one hundred eleven months below then mental ago m reading 
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piirogiftplm. The avcraRi* algebraic (lifTerenee for tins level wuh 1 77 
months above their mental age. The forty-one boys with K^s from 
ninety to ninety-niiift bad an average of 4 73 months below their 
inentnl ago in loading paragrajilis. The liilTerenct's lietween tlie 
mental age and subject ages for all the levels me nsid the same way. 
Tho significant facts of thi.s table are iiieseiili'd in h'lg 2, this figure 
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Ucndirii^ | 

piiTA^raidH 1 

1 

UOiKllllg 

words 

Antliimdu’ 

rcns<)iunK ; 

ArJlIiinoUf* 

cornjnilntioii 

Kpolling 

40-44 






3&-3fl 

30-31 

26-20 

' 


I 

1 


20-24 

1 

2 


1 


15-10 

1 

2 

4 

2 


10-H 

4 

2 

3 

1 

3 

6- 0 

4 

R 

5 


7 

0- 4 

1 

0 

2 

6 

1 

C- 1 

11 

7 

0 

0 

R 


0 

8 

7 

7 

4 

16-11 

8 

3 

7 

3 

4 


1 

3 


6 j 

5 

26-21 

1 

, , 


3 ! 

4 


3 


1 

3 

2 

36-:31 





2 

10-30 

46-11 


* 



1 

60-40 

66-61 

* 



1 


00-60 

06-01 

70-00 

76-71 



1 




prcBonts data for the Glcnwood group similar to that which h'lg. 1 
presents for tho Lincoln group. 

Figure 2 shows tho variation fiom the mental age of the various 
Bubjeots at tho diftoront levels of Intelligence The mental age is Liic 
standard from which the variation is measured and is indicated by tho 
zero line. Tho difforenco in months between the mental ago and 
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tho ages m the different subjects is indicated on the vertical axis. 
The different subjects arc indicated on the horizontal axis 

Tables VI to XI show the distribution of differences in months 
between tho mental ages and tho achievement ages in each of tlio 
school subjects for each of the IQ levels. In this group most of the 
cases fall within a range of sixty months. As in the Lincoln group 


Tahli] IX “One IIundiied to One IIundiied Nine IQ 
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the range of the cases for each subject is about tho same. The sigiu- 
ficant facts seem to ho in the change of the avciagc algobinic differ- 
ences rather than in the langc of diatiibution. 

Tables VI to IX (Glcnwood Gioup) show the dmtribiiUon of differ- 
encGS ill months between mental ago find achievement ages foi the 
various IQ levels. 
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J>'i({UTO 2 hIiowb Uio Bttiw Icntk'iicy for tins Kr«ui> of boyB of average 
rflBgti of intelligence, U8 Fig. I hIiowa for tlie retarded group. The 
brighloaL group have ftchicvemenl levcla niunh below Umt which 
would be expected of children of their iiituital age. The dulleHt 
group, which included chihlnui of file pame l(<vel of mlelligerice an the 
brightest, level in the letarded group, make Hcoren on I he aeluevemenl 
teats iiuich above their mental age. In geiieml, th(> lower the iiilelh- 
gonco, Uie Ingher the achieviniient. in ndation to tin* nu'iilal age. 

IV. Dihciwhion or Urm'irrH 

From a comparison of Figs. 1 and 2 it is evident that while the 
children with IQ’s from seventy to hoveiity-nine m the retaided group 
aro making uolMOvement scores fiotn hi\ to thirty iiionlhs below their 
mental ago in the different aulijeclH, the cliildieii of the nuoo level of 
mtelVigenco in the aveiago group uie making achievement aeores from 
two to Bkleen iiiontlis ubovi* their ineiilid age. From this it would 
appear that the relation of acinevenieiit to inenliil age ilejamds not ho 
much upon the level of inlelhgence hut upon the position of that liivcl 
in iho group receiving iiisti uclion. 

Ill studies of children in iho [niblic achools, Pmlner and others' 
have found this same lendeiicy for the aeliool aeliK'vement of hiiglit 
children to bo at a lower Itwel Ihau their mental age, and for the 
achievement of dull children to bn at a liiglior level than their ineiitnl 
ago. Tlial 18 , the accomplishment talio (KA/MA) of blight children 
is, on the average, below 1.00 and for dull children it is idiovo 1.00. 
Pintiicr* gives ns an explanation of tins that, “In general, children 
possessing superior intolligencc are the onea who are not working 
up to possible accomplishment, and the final verdict is that our 
educational system is failing to make use of the vast stoics of intelli- 
gence which lie hidden and undiscovered.’’ While it is not tuio that 
there arc “vast stores’* of undiscovered iiilelhgenee in tlic letnrdeil 
group, it 18 true that the relatively bright children of lliiH ginup aic 
not working up to possible accomplishment . 

The instruction of the teacher is u.Hiinlly adapted to the alulity of 
the middle group or to the ability of the largei mnnber If this m so, 

I Pintiior, 11., (iiul 11. Marfllinll; UpbiiIIh of llio ('oiiiltiix'i Pinout ul Kiliicfilionnl 
Survey Tost Journal oj liducaltonal I^HyrfwIogi/, Vol, XII, No. 2, pp 82-01 
Vorgorson, T. L.. Tho Bfluiiciioy (^iioliont us a Mi'UHurn of Adlniweiuont. 
Journal oj Educatwml Itmurch, Yot, VI, No. 1, pp 22-32. 

’ Pmlner, 11. '‘Intolligonco TesUng,” Clmplor XT, p 2C3 
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the duller children have a greater amount of stimulation relative to 
their ability than the brighter ones, and the tendency would be for 
those at the extremes to approach the acluoveincnt of the average child 
This may bo one reason why the brighter chilclien are below their 
mental age in achievement, while the duller ones are above. This, 


Table X,— One IIundubd Tun to One IIundrbd Nineteen IQ 
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however, should not bo so marked in a school whcie the classes aie 
small, 

Again, the tendency has been to keep childicn of tlic same chrono- 
logical ago together in spite of diffei cnees m ability. The biight 
chiUlien, tlieicfoio, arc not icqiiird to woik up to their possible capacity 
of achievement, noi aie they advanced as far as they should be. The 
dull childien, on the other hand, me uiged along in an olTort to keep 
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them in their chronologicnl nge group, iind, iH'CttUPe of Uuh msiBlent 
pressure, are likely to acquire training above llicir capacity. 

It 18 also true, that the dull cliildien of any given group have lind a 
longer period of training and oxiioiienco than the, bright cluldrou of the 


Tablb XI. — Onb IIiwiniM) Tv.r.VTT IQ avu Aiiovb 
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same mental ago in the same group. This training would tend to 
raisa the achiovonient level of tho duller children and retard the 
aohiovoment of tho bright ones in relation to their mental age. 

Tables X to XI (Glonwood Group) show the diHtribution of 
difforoncoe In months between mental ago and aolucvoinent ages for 
tho various IQ levels 









OBJECTIVE METHODS OF RANKING NURSERY 
SCHOOL CHILDREN ON CERTAIN ASPECTS 
OF MUSICAL CAPACITY 

THOMAS F VANCE 
Iowa SUifco College 

AND 

MEDORA B GRANDPREY 
Ohio State Univciaity 

The clcmenlis in the situation which focused attention upon the 
posaiblihty of evaluating the musical capacity of uursiJry school chil- 
dren by a method which might have some approach to reliability were 
three-fold: an enrollment of thirty-one children, a number of which 
wore almost invaiiably eager for and interested in the musical phase 
of the nursery school program; a teacher whose musical ability was 
considerably above the average, with a professional interest in a 
problem of this kind; and a psychologist on the staff also interested in 
the pioblem. 

Certain consideraLions had, of necessity, to be taken into account 
in outlining the project. The nursciy school at the Iowa State Col- 
lege exists pnmauly as a laboratory for sluclonls in Home Economics. 
Whatever plan of investigation may bo adopted must not intciforo 
with the educational program cither of the children themselves or of 
the college students The teacher in this instance was employed to 
teach the children and not to use them as subjects for research. 

Out of these two limitations which the situation inheienlly forces, 
an important question arises to which the results of this study may 
give a partial answer; namely, the potential contiibution of the nursery 
school teaching label atory to the science of child psychology, 

The iinmatuiity of nuisery school ehildicn is an ever present con- 
sideration m projecting a work of this character. In fact, were it not 
for the child’s mental immaturity there would have been no point to 
the project which is being reported The children would have boon 
rated on tbpir musical capacity according to the Seashore tests. Any 
method to have any value in dclcrmining a child’s nuasical capaoity 
must bo exceedingly conciclc, must hold his mtciest and must bo 
within his attention span. 

The methods to be described approximate these qualifications 
They wore conciclc, they interested the children and they wcic of 
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short durtition. Kcconls were oI>Isiihm 1 on tho following caiiacitics or 

abililiCH, 

1. IlcsponHOH to inuHic inlrodiicfil when the children were engneed 
in other HjiontanoouH inleresla. 

2. IlpspoiiHPH to the imiHic jiliiycd (luring the regular immio period 
when the children received Home encoiiriigeinent to liike pniL in it. 

3. IniiliUing the nurHcry hcIiooI teneher in Hinging un intorvnl. 

(In the inHlanci'H juHl cited, llio child wuh renponding uh ti member 

of the group. In thow'. llmt follow, I he child wu.h idonc with tho 
tottchcr.) 

4. llcnliug time to grnphnphone iiumic with the ttiungle. 

6. Goncrnl responscH to inuHic played on the gruplmiihonc. 

6. Imitating the nursery school teacher m healing rhythimcnl 
patterns on the triangle. 

7. Ratings on the basis of tho musical aspect of llic lionic environ- 
ment. 

The observations for rcsponsivcnewi, Tesls No.s 1 and 2, were made 
on a carefully prepared lihuik by a sUidenl-iiHsislant who knew tho 
children well. They w(‘ro made two or three days a week for a peiiod 
of six weeks. A stcnograpliio record was taken for eight dillerciit 
periods. Tho ratings were based on rcstionses shown (hioiigh tho 
entire period. A child could bo acoied as high as live on each of tlirce 
items, response while playing, presence in circle and rcHponso in Iho 
circle, with the possibility of a total scon* of (iflcen. 

■When the graplmphonc inuflie wim used as a slnnnluH the teacher 
simply said to tho child, "I have some now records and I thought you 
would like to hear them." Tho record was llien placed on tho 
machine and tho child encouingod to .start tho machine. Tin' needle 
was placed m position by the teacher, 'J’he iPnchci then said "Now, 
sec what you can do to that miiHic." Opportunity foi thicp dilTerent 
responses to each selection was allowed before going to tho next record 
but in each case tho only encouragement from the teuclicr was tho 
question: "What can you do to that music?" For no response the 
score was 0; for verbal response, 1; inovomcnls of parts of the liody, 2, 
movement of tho wliolo body, 3; response appropriate to type of 
Bolootion, 4. 

In the phase of tho lest whore tlio child played the accompaniment 
to the graphaphono, a plus was recorded for each mciisnre of four 
beats each of the march and skip rhythms and for each measure of 
three beats each of tho waltz rhythm played in time to the music The 
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skip and march were each sixteen measures in length and the waltz 
thirty-two mcasuics The records were Victoi 20525-B, 20736-A, and 
36774-D. 

Best results in the singing tests were obtained when it appeared to 
the children to be a part of the nursciy school program At the close 
of the rest periotl the name of each child was sung, one by one, with 
the instruction, ^*You may roll up your riig.^’ To illustrate, lot 
Jimmie bo the first child called, ‘Miinmie, you may roll up your lug.^' 
(Jimmie's name was sung by the teacher) As Jimmie received his 
direction he would put his rug away and join the teacher at the piano. 
Another child would then be called, Jimmie following the teacher in 
singing the name of the second child and so on until all had had their 
turn, Both ascending and descending intervals weio used. Credit 
was given for responses as follows: Sang one note but off pitch, 1; sang 
an interval as domoastrafeod but off pitch, 2; anng an interval of 
approximate pitch but not on pitch, 3; sang the interval, one note on 
pitch, 4; sang the interval exactly, 5, 

Imitating the nursery school tcachei in beating rhythmic patterns 
on the tilanglc made the nearest approach to the conventional test 
situation of any in the series, The patterns themselves, the arrange- 
ment, the method of presentation and of scoiing which were finally 
used were all evolved after a rather extended Liyout with a three and 
one-half year old non-nuisory school child, a kindcigarten child, 
twenty-one kindergarten children, six kindergarten ciuldicii and fifly- 
nine kindergarten children, respectively, There was, however, so little 
change in tlic technique of the test after giving it to the fifty-nine 
kindergarten children that thcisc rcsulls may be coinpaicd witli those 
obtained from the thirty-one nursery school childion who wore given 
the test last of all 

The triangle was selected from the other band and orchestral 
instruments used in the nursery school for seveial reasons. It is one 
of the favorite instniincnts which was played daily in the nursery 
school by the children tlicmflolvca. It was given preference to the 
xylophone because of its constant pitch; to the cymbals, because it 
could be manipulated inoie easily; and to liie tambourine, because it 
offered fewer possibilities for vmicty in playing 

The method of presenting the prol)lem to the ehildieii was ns 
follows; Immediately befoio the child was biought in to be tested, the 
teacher checked her tempo with the beat of the mctiononie which was 
turned off before the child came in. When the cliild came in the 
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lonoher began Inlking about llie inunglii ami hbowod the child liow to 
hold it She would gnwp it at uno of (he uiiglcH and nay, "Thm is the 
way I hold it when I play it " Then atie wouhl ha\<* llu* child practice 
taking it) helping him to adjust Ida fingera )o the proiK'r pomfion. In 

Tadue I,— AmiANOKHfcNT or UlMTlIUK Patikhsh ah tlIVKH TO T)imTr- 0 NB 
NiiiiBEtn SiriKKii, tiiiit.niiBN with TotaI. KtotiRH ron Kai ii Pattehh 
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8 
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playing she wag careful to look at the tiiaiiglc nnd to sUiko it in 
approximately the same place each time. .She then said, "I am going 
to play some little tunes on the triangle. Then you will play them 
and make them sound just as I do. LiBlon.” Immediately following, 
the pattern was played and the triangle and bar placed in the child’s 
hands. “Now, make it sound just na I did,” was repealed after the 
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presentation of the first pattern and as frequently afterward as seemed 
advisable to keep the attention of the child on the problem in hand, 

A response was scoicd as successful when the child reproduced a 
pattern once, provided the playing showed a diffeionco of long and 
short notes in the order presented in the pattern, regardless of accent 
and volume. If played once in conformity to this standard, the scoie 
was counted as 1, if played twice, 2; if three times, 3, and if four times, 
4 The child was given ample time to play the pattern four times 
before the record was made on a piopared blank. 

Thirty-six patterns wore originally selected from a number of 
melodies found in a book of songs for young children. In the evolu- 
tion of the test they were icduccd to thirteen as they appear in Table I. 
It appears from the total scores that a icairangemcnt ib necessary if 
they are to bo given in the order of difiiculty, 


TaDLO II — CoiUlBLATlONS 



IQ 

Uhythm 

i 

1 

A«o 

Homo 

I'luviroii- 

mcnL 

Tiiiio 

Itjtprpro- 

tnlion 

Tono 

iniyllim 

33112 







Abo . 


37111 






Homo llnvironmoiit 


28111 

05112 





Time 

- n±n 

10 1 10 

241U 





Inlcrprotnllon 

12112 

-* 13 1 12 

20 hll 

12112 

20111 



Tnno 

- 04 Liri 

28113 

20114 

lOi 14 

ooiir> 

28113 


UcfipunaivoncflB 
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41112 
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To get a rating on the homo environment of the nursery school 
children as it pei tainod to music, the teacher went into the homes of 
the thirty-one nuiscry school children with a prepared form which she 
filled out by the method of dncct questioning. The form earned ques- 
tions relative to ihc pi o vision for musical impression and expression 
in the homo and the musical training and expeiionce in tlie homo and 
tlio musical training und oxperioncc of the paicnia. Scores wore given 
on a basis of fiorn one to five ci edits on each of the following: inatru- 
mcnls in ihc home, mnging, training of paionts in music and later 
experience of paients in music. 

The limitations of this papei do not permit giving ihc results m 
full. The development of methods of dctci mining special aptitudes 
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DtitH liM rt^riimii r««k 

Gnxpji I.— Individual rankniftn nK^'fl idauliral 

Heading from iolt to right, iadivldunla of idonlinil ngra rirn gruupod in jjaira In 
1 10 cnflQ of tho hrotpair, No 232 ia aiiown to ponHOfifl iiiuaical rapnritiOH of ahovo avornRO 
or uoarly nverago, whilo No 211 fnlla far liolow n^cTago No 22 i rnnkfl woll above 
nverago m timo kcO|)ing ability, and idllmiigli ho fadu to roarli Uio nvorago mark in 
other cuDac tlofl flcorcfl well above No 220 of Idciillrnl ago A Minllar nmipaneou 
y 0 mndo in the cueo of No. 217 and No, 215, Itoinn vin ironrimnt. {ritorprotaiioii 
ana roaponaivonoHB iQ rnuflio uro ubbrovIaUnl in tho graph rpi»|jntdivoly aa followa 
jiQino J'm,, Iut„ tind Uohi)» 
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of young childion la at present more important than results. The 
tables and graphs which accompany may be taken as samples 

Graph I, giving a comparative picture of eight children paired 
according to ages, is suggestive of the amount of individual differences 
in icaotion to the various teat situations. Whether the assumption 
that one child has greater musical capacity than anothci is true can 
only be determined by a study of tlio child some ten or fifteen years 
latei. Then there will be the possibility of correlating the rcsiiUa of 
the work in Ihe nursery school with the results of the Seashore tests 
With this in view all om nuisciy school school children are being put 
through this series, that sufficient data will be available to make corre- 
lations significant. 

Graphs II and III seem to show that the two tests which they 
present arc better adapted to the older children then to the youngei 
The smaller number in the singing test is due to the fact that the 
younger children could not bo induced to sing They did do some- 
thing with the rhythm tc.st but eight of tiicm not enough to get a score 
of more than zero The tests aio not iccommended for children 
younger than three years In the rhythm test the median for the 
kindcrgai ten children was H 8 , for the four to five year level, 8.84 ; the 
three to four year level, 4.18 and foi the two to three yeai level, 2 43 
Further, the correlation of rhythm with age in the kindergarten was .03 
while in the nursery school it went as liigh as 37 To give any test of 
special aptitude (oo early may give merely a mcasuro of maturity and 
not of the aptitude in question. 

The highest coi relation to bo found in the table is ,62 between 
responsiveness and homo onvironmont. It may suggest a possible 
carry over of musical pxpros.mon in the homo to expression in the 
nurseiy school, making perhaps some slight allowance for inheiitancc 

One or two by-pioducts scorn to have something more than pass- 
ing interest. In the singing test the average scores for the descending 
intervals are higher than those for the ascending intervals. The 
descending intervals ivcrc also lower in pilch. The question arises, 
"Would this diffoienco still obtain if pitch were held constant and a 
much larger number of cases studied?” 

In the rhythm lest the patterns m which the quartei notes pie- 
ceded tho half notes received highci' scoies than those of llie lovcrse 
order This difforcnco obtained in botli the kindcigartcn and the 
nursery scliool groups. 
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Taken as a whole, the study may be used as an illustration of the 
use of the nursery school as a teaching laboratory, as differentiated 
from a research laboratory, for securing data which may prove of 
scientifio as well ns of piaotical value. Practical results certainly 
accrue in tlic stimulation of the interest of the nuisery school staff to 
secure as reliable information as possible about the children. Only 
the future can detormmo the scientific value of such a study. 



factum. MKMOIIY OF SKC’ONDAtlY 8(’1I()0L FUPILS 
FOR A HIIORT ARTICLK ^YUI(“H TTIKY READ A 
SINCU.E ^ruiK‘ 


ALFttHl) « U1KTZ1-; AND (iKOUtiK JONF:« 


Uiiivrmly of Fill.i|iui^li 


IntHOIMU'TIOS 

The Problem. A rovi4>w of llio lili'mtiin* rcvcnlH lloit but fow 
of the many bUuIicb of toemory I oiicli iiium ihu ‘’iibjfcf fioui the* point 
of view of whnt is iiclually rcnKMiilnTotl of flunks (‘X|H‘ri(‘nc(‘<J iii ordi- 
nary life aitunfiouR. Tlin wrilcra fool lliai rownroh in iliia KOiicrivl field 
ahould givo profilablo rclurim and liavo undorfakon iiii invoitigalionof 
n tyiiicul incinory ailualion, iiamoly, tliul of ik aiiif^lo ri'iiduig of a 
ehort infornmlivo. arliciu by pupils in llio aopoiulury scIiooIh. The 
prcftcnl Btvidy in ivu ftlloinpt lo dolormluo tho iauKi> and ivvomKo extent 
of immcdinle and delayed factual inoinory «tf puinlH in (IrailCH VII to 
XU for n short nrliclo which llioy road a aiu^lo liiiio and Iho rolalion 
which obUuns between inoinory at inlorviilH of moroasiiiK loiiKlh. 

This and rclalod problojimoiiiorKOin aonuHnloralion of llio, practical 
significance of the classical labornlory Rdnlios of moniory. It is 
uncertain, for exaniplo, whcllior wo rotnoinbor what wi' obtain by 
reading and study in tho smno way that we roinoinboi nialoriid loarned 
by roto to the dogreo of ono orrorloas and unliosiiating i coital The 
pedagogical significnnco of exact infonnalion upon linn point rolulivo 
to a single reading of nn nrliclo is clour in view of the fact limt pupils 
in school and college commonly proparo asHignnionls by ri'ading lessons 
a single time.’ 

Related Studies . — A number of rclalod invcaligalioiiH have been 
reported during tho past ten ycuiB. Jonc.s Ktudiod llu' memory of 
college studenta for the content of lectures m psycliology ’ The 


'Acknowledgment is made Ui Profiwor H 11 Ilni'd for fuiKliunciitnl 

BUggCBtlOIIB. 

• Cf . Yoakam, G. A.i ‘'Reading and Study '* Tho Mncmillnii (Jo., Now York, 

1028, pp, 186-100. 

* JonCB, 11. E : Exporintcnlal Studies of College Tcncliing, Arehiveo of Pfli/- 
ehologi/i No. 08 (1023), 
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students knew an average of 62 per cent of the facts piesontcd when 
they were tested immediately after the lectures. After three or four 
days they remembered an average of 46 per cent, and after eight weeks 
memory dropped to 24 per cent* 

Several writers rcpoit conflicting rcBults regarding memory over 
the summer vacation ^ llccently Eassett published a study of tho 
retention of history in the sixth, seventh and eighth grades.^ Objec- 
tive tests wciG given at the end of the course and again after intervals 
of four, eight, twelve and sixteen months Computing retention on. 
the basis of the scoies in tho initial tests, average memory scores of 
86.01, 81 51, 76 72 and 71 96 per cent respectively were obtained 
Since, however, no measures of validity and reliability are presented, 
and since the tests are short and include four different types of ques- 
tions to which equal ciedit was given in the scores, the validity of the 
conclusions may bo questioned. At least tho method hardly justifies a 
statement such as, *'It is woilhy of note that after sixteen months tho 
children know seventy-two per cent of the history wluch they know 
at the end of the semcstci.”® 

In respect to method and results theie are many points of similarity 
between Yoakam’s study of tlie effects of a single leading and tho 
present investigation. IIis liiuling that the effect of a single reading 
gives on the average less than half of tho total ideas in the article^ is of 
especial interest hcio. lie also found that that the effect of a single 
reading vanoB with the individual and from giado to grade; and he 


* Garfinklo, M A Tho Effoct of tho Siiminor Vacation on Ability in tlio 
FundamonlnlB of Anlhniotic /oio/nd oj Edncational Psychology ^ Vol X, 1010, 
pp 44-47, Kirby, T, J ''PinctKO ni the Case of School Cliildrea ” Columbia 
University Contubutions to Education, No, Bureau of Publications, Teachers 
College, Columbia University, Now Yoik, 1913, Noonan, M E ''Influence of tho 
Sumnioj Vacation on the Al>iiilips of Fifth and Sixth Guide Children ” Columbia 
University Contributions to Education, No 204 Buieaii of Publications, 
Teachers College, Columbia Uiiiveisity, Now York, 1020, 

^Bassett, S J, "Bxdention of Ilistoiy in the Sixth, Seventh and Eighth 
Giadcs with Special Ih‘fou'ncc to the Eiietorfl tlmt Influence Helen lion ” Tho 
Johns Hopkins University Studies in Education, No, 12 JohiiR Hopkins Pi ess, 
BaUnnoro, 1928 

^ Seo ibid , p. 51 

* Yoakam, G A,* Tlio Ejecta of a Single Heading, UmverAiiy of Iowa Studies 
tn Educaliout Vol, II, No 7 The Univormty of Iowa, Iowa City, 1024 Seo 
especially conoluaions on pago 08ff. 
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queations wliclhcr a sinulc reading without any iininedialo recall will 
leave any iinprcaaion on the mind of the learner after a liijise of twenty 
or thirty daya, unleaa the mntennl la very inlerestiiig or alriking. 


MaTWHM^ ANU MM'IIOI) 

(Sufijcrf.'i.'-Cliildron m Grades VH to A'll acted «a wib/ecls, n total 
of 2789 Inking part The cxperimeulal groups conaihled of 2002 
pupila in the junior and senior high schoola of Union town, Pa. Kach 
grade was divided into aix numerically npproMiriately eciuiil gioups for 
purpoacB of rotation in the oxiicriments. The rcnminmg seven 
hundred Lwcnly-scvcn aubjcct, drawn fioiii neighboring hcIiooIb, wore 
used in control oxpcrimeutB: Control Grou|) A, two lumdrod sovenly- 
eiglit children, for obtaining intercorrclalions between the loslsi 
Control Group B, two bundled forty*fivc pu|)il», for im invcRligation 
of previous knowledge of the, articles; (Control Group (ine hundred 
oighly-two pupils, for obtaining a incusure of how well pupils com- 
prehend the materials, The median scores of these groujis in intel- 
ligence tests, reading and vocabulary tests correspond closely to 
published norms; hence, It may bo safely assumed that they me fairly 
typical of the secondary eehool population.* 

The Readiny jSclccJfons.— Thrce inloresling and liighly factual 
articles were used aa loading selections, each printed in the form 
of a four-page pamphlet. “Hadium: The Magic Metal,” containing 
1265 words, is an account of the discovery and uses of radium. "The 
Early Germans” describes tho habits and customs of the early inhaliit- 
ants of central Europe and is 1061 words in longlli. "Hit Kichard 
Arkwright” is an account of tho life of the lOnglish inventor and con- 
lams 1279 words. These articles are well suited to the pm pose foi 
which they wore selected, since they abound in facts upon whicli 
questions can bo formulated and are of suitable difUcnlty foi the 
grades studied.'* 


* Coniploto tnbloa for all aiuninnriiiiUioiu cattUiiiwd iii this jwifX'r are l<> Iw 
found in A. G. Diotoo, “rnclunl Memory of ficcoixlftry Suliocil Pupils for a Hlioil 
Article Wliicti Tiioy iWd n Single Time." Doctor’s dissortiUion, Liliriiry of tiie 
University of Pittsburgh, 1930. 

* For methods of detormming dinieiilly cf. tbtd., jip. Sl-.lll 



Factual Memory of Secondary School Children 


689 


The Teals — The testa woic made up of five-response multiple 
choice typo questions and were printed in the form of four-page 
pamphlets. An effort was made to thoroughly canvass the articles 
for all thought units contained so as to make the mcmoiy testa aa com- 
plete ns possible. The test on Radium contains one bundled items, 
the othei two one hundred twenty-five items each. 

In icspcct to validity, objectivity and reliability those tesla com- 
pare favorably with some of llio bettor tests in standard use. Validity 
is attained by thoroughly covering the content of the articles in the 
questions and is icndered evident by an average intorcoirolation, 
corrected for ntlcnuntion,, of .80 ± .014 between the tests. Objec- 
tivity is attained by (a) careful instruction foi administration, (6) clear 
directions to pupils, (c) unambiguous questions, (d) uniform and well 
maikcd scoring keys in the form of stiip stencils, and (c) supervision of 
scoring by one responsible person. The lelinbility of the tests is shown 
by the following figuics, llie reliability coeflicicnls boing obtained by 
applying the Spearman-lirown piophccy formula to the correlation 
between odd and even halves of the tests: 



lladuun 

j Germans 

Arkwright 

RcliabilHy of half test 

82 1 008 

80 ± 005 

85 ± 008 

Rolmbihty coofllcient 

00 ± OOR 

Od ± OOH 

02 ± 004 

Index of reliability 

05 i 002 

07 ± 001 

00 1 002 

PE of estimate 

3 03 

3 (30 

3 72 

PE of inensuremont 

2 03 

2 50 

2 08 

Number of cases 

060 

007 

016 


Sconny — Since the tests iiio designed to measure the amount 
letainccl, tho best typo of scoie seems to be the pcicentago of items 
answcied corioctly. In this way each item is considciod a unit, 
relative difficulty of the separate questions being disrogaided. No 
attempt is made to coiicct for guo8.sing, since instiuctiona wore given 
not to guess. It may bo staled that tins method of sconiig icsultod in 
distiibiitions approximating tho normal about as well as can bo 
expected from the mimbor used. Aikwiight gave an especially good 
fit to the normal cm vo. 
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/’rocedure - - The method of comluotuin the (‘\|>prittipiil!j wivg lo 
give the pupils an article, with iirntriirluniH lo read it a hingle timo in 
order lo nnawor a memory Icfll at eome time later The ))upil was 
allowed lo rend at hm own rale. Tlie test was given mmioduucly 
after thn reading in i*/Xi)eriiiK‘nt 1, and after interviilH of I, i J, :t(( and 
100 days in Kxpcriinenta 2, 11, *1 and ."i respectively lOach group 
participated in the immediate memory espeinnent nnd in two delayed 
memory experiments, using different nmferniln for eneh. The nuuiner 
in which the groups and umleriala were loliiled iippeiim m the following 
schetno : 


Group 

ExporimpitU pHrliciimUnl iii nnil nmloncd Mm\ in ouch 

I 

Exp. 1, lUdiiim 

Exp 2, Orriurtnii 

Exp fi, Arkwriftht 

11 

Expt 1, RAdiiim 

Exp. ik (U'minna 

Exp t, Arkvuight 

irr 

Exp. 1, Oonnttnn 

Kxp. 2, Ark\\nglit 

t'>p 16ifJutrn 

IV 

lixp. 1, Goriimna 

Exp, 3, ApkwriKlit 

Exp. 4, lOnlmm 

V 

Exp. 1, Arkwright 

Exp 2, Hull lU III 

Exp /), (JormaJiB 

VI 

Exp, 1, ArkwriRhl 

Exp 3, 

Exp. (IrnimiiB 


The reading and testing periods were udmiiiiHleretl by the lOnglish 
teachers of the regular claases, thus providing a natural school-room 
situation to the subjects The teachers were carefully eoaohed in the 
manner of conducting tlie oxperimcntB and iiiHlruelcd lo lepoil all 
irregularities to the oxpcrinicntcr. IJefore (he experiincnis proper 
wore begun, all groups were given a practice exereiso cmismting of a 
reading selection and test similar in nature lo Ihose aliovc described. 
This served to acquaint the subjects thoroughly ivitli the details of 
taking tho tests. 


Sui'I'LBMBNTAUY llESm.TH 

Several factors which cannot bo cliiiunalcd by our melhod mllucnce 
the results obtained. The nppioxiiimlo extent to which two of llicao 
enter was made tho object of two control cxiienmentH Tho points 
investigated arc (a) tho infliionce of previous knowledge and alnlity lo 
answer questions by logical thinking nnd (6) tho fiuluio of pupils to 
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answer questions because of comprehension cUiReulties and caioless 
work habits 

Previous Knowledge — Conti ol Group B was required to answer 
the tests without previously having rend the aiticles. They were, 
furthermore, instructed to guess when they did not know the answer 
to a question. The results nic somewhat confusing, since tho medians 
are in inverse i elation to grade. The reason for this, however, 
becomes apparent upon examination of the papers The lower grades 
complied more fully with tho directions regaiding guessing and, there- 
fore, had more opportunities of getting items coiicct by chance Tho 
actual medians range from 32 3 per cent in the seventh grade to 23.5 
in the twelfth for Iladium, fiom 30 8 in the seventh to 25.0 in the 
eleventh for Germans, and from 24.8 in the seventh to 18.6 in the 
twelfth for Arkwright. 

The instructions regarding guessing wcic given for the purpose 
of extracting the correctly guessed items from the scores by the 
commonly used formula foi correcting multiple choice teats;* however 
the correction could bo accomplished only in the seventh grade, since 
in this grade the directions wore strictly followed When tho scores 
for the seventh grade aie subjected to the formula, tho following 
results remain as the appioxiiimtc scoies that pupils in this grade are 
able to malvC without previously loading tho articles: Iladium 16.4 
per cent; Germans 13,4 per cent; Arkwright 6.0 per cent These 
amounts aic interpreted as due to previous knowledge and logical 
thinking and aic m harmony with the findings of Yoakain in a similar 
experiment.* 

Comprehension Difficulty and Carelessness — ^The ability of pupils 
to answer the tests when they arc allowed to look up tho answers in 
the articles may be taken as ii measure of how well they compiehend 
the materials and how caioful they aic in Ihcir work. Conti ol Group 
C was used for determining this factor The means for the respective 
grades range fiom 82 0 per cent in the eleventh grade to 66 0 m tho 
seventh for Goiinans, and fi orii 73.0 in tho twelfth to 54 3 in the seventh 
for Arkwright. Tlie diffeicnce between grades are for tho most part 
reliable. Tlic average of all giadc.s m Germans is 75 7, m Arkwright 
63 5. Thus this giiido missed aliout twenty-five per cent of the 

' Corrected acoro = No, right — 

’Oj>. £il,pp C8-50 
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qucHlioiiB on OermanH anil tiJKiul, lliiriy-KOxoii ]>pr oonl of those on 
Arkwright Ixicauflc they did not coiiiprrtirnd the inaU'riuh read or 
were too carelcsH to do ihoronghiv’ ricfuruto work 

Allliough the influence of the ahove fartora have' not been deter- 
mined witli exaclneaa, nevcrtlieleas tlic ponlrol t'\i>eriim‘iiiK show that 
it is flignificant; and llie <>x|KTiiiu'iilnl ri'xdlH iiiUHt, accorrlingly, bo 
interpreted by tlic reader with theM> facia iii niitid. 


FArri'Ai. Mkmouy aktkii Kivk iM'Bin'Ats 

»S/afis(tc«l Trmlmcnl. -Two inelliodK of «iiinnmri7,ing the results 
arc employed. The first makes use of the common atalislical device 
of describing group results in tonus of nieaim an«l standard deviations. 
This method brings out the trend of the data m a slrniglitforward 
manner which needs no furllier coinnicnt. 

The other method is made necessary lieoiiuHe (ho technique, of 
equaled parallel groups was not followed. For this reason t he various 
sub-groups arc only roughly comparable, llie group average depending 
to a large extent upon the ability of the particular group relative to 
entire grades or nil groups taken together. To obtain coinparablo 
results for grades or other sub-groups, it i« ncce.Muiry (iml to IrauBmulo 
scores derived from the throe diffcnait matennls into eciuivalent terms 
and then to combine the results into an average repre-Meiitnlive, of the 
combined gioups. 

The best mclbod for nccompIiBliing (Ida is to make use of the 
regression equations derived from the corrt'lalKiim between the 
materials. It will be romcmboiod that (Jonlrol (Jroup A was iised for 
Ibo purpose of getting correlations between tlic three nialeruilH. Fiom 
these correlations the regression equation between ituduiiii and 
Arkwright and behvecn Germans and Arkwiighl were derived, the 
resulting oquatioiis making possible Ibo conversion of re.sullH m Itadium 
and Germans into scores cquivnlcnl to Arkwnglit score.s and the com- 
bination of all threo groups in terms of an average fur tlie latter 
material. To distinguish this derived scorn finm the seort's of groups 
actually using Arkwright the term "A-seore” will bn used. Tlio 
actual equations for deriving A-scoros from the rosulta in itadium 
and Gorman were found lo be: 


A-scoro = .80 lladium 4- 2,4 == .07 Germans + 11.0. 
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Similar ecoroa may, of course, be derived in terms equivalent to 
Radium or Germans. The reader may get an approximate value for 
R-scoros or G-acores by adding ten points to the A-gcore averages 
herein reported. 

Immediate Memory — Table I givea the means and standard devia- 
tions of the respective groups for the material which they lend and 
the A-scoie avoingos of the combined groups in iinmcdinte memory 



l^ia 1 — IIIatoffrAm for immoditito inomory of Arkwright compared with a normal curve 

fitted to tho data 


The total range of the diatribuliona arc fioni thirty-one to one hundred 
per cent for Radium, from aixlecn to one hundred pei cent for Germans, 
and from sixteen to ninety per cent for Arkwright, Thus pupils in tho 
junior and bomoi high school scoio over four-fifths of tho entire scoring 
range of those losls, which allows that individual diiTcioncos in this 
ability are great. Tho diaUilnitiona for Radium and Gcimans are 
somewhat negatively skewed, *S7i: being —.362 and — .266 luapectivoly ^ 
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Tine imlicalCH llmt there is f-oirit* piliiii? up of iinnu'diulo itioioory scores 
in t!ic \ipper part (tf Ihf* ranK<’ for iIh*h<' nriieli'H. ArkwriKlil, however, 
gives n very gootl upproxiinaiioii lo ihe timihf-nm eurvt*, ,S'A, hojng only 
.032 iind iViiraon’n chi-Kfiunre test of gooilia-hf of lit giving a P vnliic 
of .370, which i« very enli^factory hir a pojiulnlioii of uligiiliy more 
than WO.’ The comparison of ihe laltor (liHlrilmlion with the 
theoretical norninl curve lilleii lo the tialu ih ehown unijihically in 
Fig. 1. 
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Delayed Memory, One -'Tlic nwriige leHiillH for memory after 
ono day arc given in Table, 11. The dialrihulions me aiimlur in nature 
ns in the previous cxporiinont. The range in lliulmm in from 1 1 lo Ofi 
per cent, in Germans from 10 to 95, and in .4 vk weigh I. from (> to So. 


’Sco K J. Ilolssingor, "illntietiunl Methoda for SluileiiU of I'.'diienlioM 
Ginn and Co., Boston, 1028, pp. 215-2.18, 
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Thus the same wide range of individual differences is to be noted as in 
immediate rnemoiy. 

Delayed Memory ^ Fouileen Days , — ^liesuUs for memory after four- 
teen days are sliown in Table III. The distributions at this interval 
have bocoinc positively skewed, showing that the task is becoming 
moio difficult, Sh is .191 for lladium, ,405 foi Germans and .405 for 
Arkwright, The lango in lladium is fiom eleven to seventy per cent, 
that in Germans is fiom six to cighty-fivc per cent, and that iii Ark- 
wright from one to sovonty per eent. Again wc find ability in these 
grades to range fiom very low to very high. 


Table III — Peucuntaoe Memouy aftbr Fourtedn Days 
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Table IV — Peucentacih Memory ArrBii Thirty Dayr 
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11 0 
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835 


Delayed iV/cmo?y, Thirty Days , — Average icsulls for memoiy after 
thirty days arc shown in 'J’alilo IV. The nature of the distributions 
(skewness) is the same as m the proceeding experiment Scores in 
Radium range from six to eighty per cent, in Germans from six to 
bcvcniy-fivc, and in Arkwright from one to sovonty-five. 
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Delayed Afemory^ One Hundred Dnyt^ Tli<‘ rmiilH for the fifth 
c\pf*riini'iit art' nliown 111 Tsiblt* V. 'Ilu' Hr(»r<‘H in Hu<liuin range from 
one to wvonly-livp per ffiil, in (•priiiiiiifl from one to flixly, andm 
Arkwngltt from one In ninety Ah m tin- previnua ex])eriincnt, skew* 
WC 89 is sUtuhtly p<tKUive, plmwinK luamug rtf ^e(tr<'« lielnw the mean. 

T'liii.B V - I’riH rsTAtiK MKMuHt Arrrn flsp, ItiThtiiiKii Hath 
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OOMPAUI8ON OK (lUAIlKh IS KaOTI Ali .MkMUHY 

Grade Averages.’ Tlie (inlii prcwnletl in Ihe pievioim Tables 
(I-V) enable im to make (be foDriwnig ermiiiariHnna of llio grades 
participating in tlicso expcriini'iita. 

In immediate, memory tlic averagi-H inercnf-e tpiile markedly from 
grade to grade. Of tbe fifteen compariHons (bat loay be made on the 
basis of ibo roauUs of the varbius maleriiilH (‘igiil, of (lie diOercnces 
tvirn out to bo four limea their prohaiile error.s nr moio luul arc, 
therefore, completely reliable. Tlirei' inoio eompuriaoiiH uie dilTcr- 
enocs 1.8 times their probable errore, or belter, lbi‘ clmneeH of n (me 
difference greatci than zero being at least ninety in one lumdK'd A 
comparison of the A-Scoro means loveals nii average increiiso of 3 05 
per cent from giadc to grade, all the differences being reliable 

In memory delayed one day the graile averages ugam mciense as 
in Experiment 1. Of the fiflcen conipaiksonH give lelialilo diffci- 
oncos, and four more are more Umn 2.6 tlmeH Iheir prniiable eiiois 
The A-Scorc differences between (be nieaiiH of (be gradea avi'rage '1.5 
per cent, but all are not completely relmlile. 

In the expenmenta wi(h inlervals of fourteen dny.s ami longei, 
no relationship is to be noted between factual inemory and grade, (be 
rank older of the giadcs being haphazard and numt of (be diffeicnces 
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being negligible. Wherens the means of the seventh and twelfth 
grades in the immediate memory and one day delayed memory 
experiments are well set apart by a distance of about 1 5 slandaid 
deviation of tho entire distribution, the differences between the 
lowest and highest averages in the experiments with longer intervals 
are small It may bo inf ei red that groups originally quite diffeiont 
with respect to kiiowlodgo of nn article road a single time become more 
and moie alike with lapse of tune — i.e,, the factors influencing foi- 
gelting operate differently on gioiipa of diffciiiig abilities. 



li’ia. 2 — Porcontjlo ourvoa slio^ving tho ovorlnpping ot grndos in immedlnto niomory for 

Arkwright 


Overla'p'piriQ 0 / Grades - — ^While the average score in nnmcdiato 
and one day delayed recall increasea poiceplibly with grade, nevei- 
theless ncljacenfc grades ovorhip to n considcrablo extent Wo fin cl, 
that tho Hcvenlli, oiglith, ninth, tenth, eleventh and twelfth 
grades icach or exceed the mean in iminediaie momoiy of lladium for 
all grades taken together by the following amounts respectively: 33 G 
per cent, 25.0 per cent, dO 3 per cent, 57 0 per cent, 58.0 per cent, and 
86.8 per cent. Again, 85 0 pei cent of the distribution of the combined 
grades for Radium in immediate memory fall within a lango common 
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to all sixgrfltlcs, and, siniiliir])', 87,2 per cent of the combinod scorea 
in Germnns ond 82,0 per cent of Ihoic Jii ArkwriRlil Tlio degree of 
overlapping is slrikingly brought out by I he percentile graph for 
immediate memory of Arkwright, b'lg 2, from winch iiiiiy be read the 
percentage of scores of any guide wliicli fall below or nbove any given 
point in the distribution of any other grade Tlie curves have been 
smoothed free-hand. 

Gorre!ahons."-The prorlucL moment eorrelalions obtained (or 
the factual memory results of scvcrtil of the groups willi grade in school 
arc presented in Table VI. It will bo seen lliiil the correlations 
between immediate memory and grade arc positive and low, those 
between delayed memory and grade aic negligible, Those icsuUs arc 
in accord with the foregoing analysis of grade averages. The alight 
correlations whicli do e.Niat, as will lie. shown in a later article, arc due 
to other factors rather than the accident of grade. 


Tabi-b VI.— ConiiKLATioNa or Fsctiml Miwoiir and Onsm? jn Sohool 
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WHY OTIS’ “IQ” CANNOT llE EQUIVALENT TO THE 
S'rANI-’OIlD-BINET IQ 


I'KYCJinO OATTKUi 


] rnrviird Uiuvomly 

Dr. Otis Itna dovirctl a mciimirc of hriKhttioHS for uso with hiB Relf- 
admlnislerinfi Tanfs wliiph ih dorivrd by dctcrminmR the number of 
points in score the child vurics from his ngc norm, if he is above tho 
norm this amount ifl adiiod to one luindu'd, if below subtracted from 
one hundred. Dr. Oli.s .states that when an IQ has been found by other 
menus than tho Binet Tc,sls the Iciin "IQ" must not be used without 
qualification, yet he wiites (hut "it seemed l)0.sl simply to call this new 
monsiirc of briKhlnops an ‘IQ,’" He apparently justifies the use of 
the term "ICi” on the erroneous belief that liis ineasuic of brightness is 
equivalent to the Bincl Iti and (hat the group test Ki’s obtained by the 
standard method nie not. 

Dr. Termiin found the middle fifty per cent of tho Slanford-Binct 
IQ’s to have a range from ninety-two to one liiindrod ciglifc Dr 
Otis found the iniddle fifty per cent of the scoros made m his tests to 
have approximately tho same range in the soveral age groups, that is 
that fifty per cent of the cases fi'll within eight points of tho norm, ho 
tlion concluded : 


Forlinifttniy, lln'roforo, each pnint ui llic more fif nu iiKhvidtia! aimvo or below 
tho norm for lufi 11^0 lopri'scnln a point in I(i ubove or below 0110 luiiulicd If an 
mdiviflual scorooxrcodH (he norm for hiB by twelve ]ioin(ii| hiH IQ laoiie hundred 
twelve . TIiih bonify the eiiHC it Heenioil bewt min ply to cull this now measure 
of brightncflfl nn “KJ 

Dr. OtiH huB to lake, into account the fact that two diatiibu- 
tfone may have the huine niecliuns ami (ha aarnc mkicllo fifty per cent 
range and atill diftci widely at (ho exlicmca It can be ahowii both 
theoretically and eininucally I hut (hoie jh a confltant diffcionce between 
llie Binct KJ and Olia’ "KJ" at lh(‘ (‘vtieineH, cHpecially the upper 
oxUoinc, That tlnn muni of n(‘c(‘eml,y l)(‘, tiue cun be (kMiuinstiated 
from the data given in iho manual of (IneelioiiH foi the ^hltis Hclf- 
admiiimtering "IVhIh of Menial Alnlity, An inttpcclioii of Clio tabic 
of norma to determine the highcHl and loweat that it 13 possible 
for a child of agiven ago lo obtain by this method will show the iinposai- 

m 
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bility of the range of Dr. Otia’ nKMiaure bomg equal to that of the 
Kinct IQ. 

While Dr. Otw makes no mention of llm rclnlivc reliabilLty of hia 
tabic of norms at dificrent ages, it is perhups, not fair to exiicct too 
great accuracy at the extremes. Therefoie, the ages of 10-0, l!l-0 and 
15-6 havQ bean sclecled for a coinparison of the Hincl KJ and the “IQ" 
obtained by Dr. Otis' method. These tiges ai e the <iuai tile points of the 
ngc range of the table of norms and should include the moio roliablo 
part. The curve to the left of the accompanying chart in the frequency 
distribution of the IQ’s of Professor Tennan's original one Ihouannd 
unsolected Stnnfoul-Binet IQ's. The curve to the right is a ftequciioy 
distribution of the liinot IQ’s of his six hundred forly-llirco gifted 
children, largely from Grades III to VIII and nil below the ago of 
fourteen years The lowest and liigliest Otis “IQ's'' that it is 
possible for children of n given ngc to oblum on the Intermediate 
Self-administonng Test aic indicated on the IQ scale at the foot of 
the cliart. 

The highest possible Otis "IQ’’ that could be obtained liy a child 
aged 13-0 on this test is one hundied thirty-one and tlio lowest fifty-six. 
This is a narrower range than that of the Htunford-llinct IQ's. If 
Professor Tcrman had used tliis test and melliod in solcclmg his gifted 
group he might have found one or two cluldren Hint incusuted up to 
ono hundred tliirty but none aliovo one hundred Ihirty-ono (liia group 
of SIX hundred forty-three contninod only ono caso witli an IQ below 
one hundred thirty-five). At the ago of 10-0 the highest possible Otis 
“IQ” is ono hundred forty-eight (approximately one half of Professor 
Terman’s gifted group had IQ'a of ono hundred fifty or higher). Tlio 
lowest a ohild could attain at this age is soventy-threo I'ivety large 
school system has a number of children with Ihnct IQ's below seventy, 
At ago 16-0 the highest “IQ” obtainable is only ono bundled twenty 
approximately two standard deviations above tho norm, lOven if the 
advanced test were substituted for the intcrincdiato the highest possible 
“IQ” would still bo only ono hundred thirty-sevon. The lowest 
“IQ” obtainablo at this ago is forty-live, cvoii this is not as low as 
tho Standford-Binct IQ's fiequontly met with. At no ago is there a 
possible Otis “IQ” range of more tliau seventy-five points. At 
tho age of 12-0 it is theoretically possible to got a range from 
slxty-threo to one hundred thirty-eight, A younger ohild could 
get a higher Otis “IQ," but could not make one as low as sixty- 
three, while an older child’ could make ono lower than sixty-thrce, 
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but would have no possibility of makinp ono as higli ns one liundrcd 
thirty-oigbt- 

Similar conclusions were rcuclicd in an curlli'i sttuly* btiseil on Iho 
actual IQ’s obtained by Riving Forms A and H of llio Otis Helf-ndniniia- 
tenng tests nnd at least two 8taiulard-Hinet losts to three hundred 
twenty-two school cliddrcn raiiRUiR in riRO from ten to thirteen inclu- 
sive Those children who nceordiiiR (o ihe Slnnfmd-Ihne.t tests 
poRBCBBCd an average grade of lulcHigence weie found (o be, about six 
points lower on the averngo in Dr. Otis measure in Form A and two 
points above in Form B. At the lower levels of intclhgoncc tho 
differences arc Bhghlly less, but at the higher levels ns selected by tho 
average of two or more Slanford-Binct IQ's tho Oils measure is 
markedly and consistently below that of the Slunford-Binct, especially 
in Form A where the average difference was about twelve points 
at tho Binet IQ level of ono hundred twenty to one hundred 
thirty and about seventeen points for that above one hundred 
thirty. These are median diffeiences, (liero woro, of course, many 
larger individual differences, fifteen per cent of those with Binet IQ's 
above ono hundred twenty-four varied by twenty-five or more 
points, all in the negative diroclions 

Thus tho Otis “IQ" is seen to differ from the Binet IQ iiy an 
appreciable amount near the norm and to differ markedly at the 
upper extreme. It is difficult to see any jiislilicalion for applying the 
unqualified term “IQ" to a measure which differs from tho Standard 
IQ to such an extent. It is slrango that Dr. Otis should propose 
doing so when ho writes on the same page that: 

It Bocma that tho term ‘‘IntoDigcnco Quoliont” m coming to have a legal recog- 
nition, but IQ's as soinotimes derived from group teals of menial ability boar 
Uttlo relation to IQ’s derived by the Uinct TesUs’ . TJnlehs it is dielmctly 
undorstood how IQ'a wore derived . they should ho dcsignaled by aoino iiioans 
such as National IQ'a, Oils IQ’a or Ihnct IQ'a. Tlio term "IQ” when not ao 
qualified or undoratood, must be mlerproted ns lefening to acliinl IiitclligciiGO 
Quotients found by means of the lliiiot Teats ’ . It la llie pui jioao of tlu* author 
to UBo tho term "IQ" only m its original sigmliennee * 


’ OattbIiLi, PsYonn. IQ'a nnd the Olia Mcnaiire of llrighliieHs, .Iimriml of 
Edwalional Research, Juno, 1D30. 

*“0U8 Solf-admimaloring Teats of Mental Ability.” lloviacd Mnimnl, p C. 
’"Statistical Methods in ISducationnl Mcnaiiromonts," World Book Co., 
Yonkers, New York, p. 160, 
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Yet in proposniK liiH now inoasurc of ImRlitncss which has ]uBt been 
shown to differ from the I(i both in Us moaning and method of deriva- 
tion he apparonlly liehovos that he is adhorinR to his statement that 
“It is the purpose of tlic author to use the term 'Ity only in Us origi- 
nal significance" when he, ivnlea* . . It seemed best simply to 
call this new measure of biighlness tin ' KJ.* " 



PHOGNOSIS of abilities to SOLVIO EXEIK'ISES IN 

GlCOMETllY 


WINONA M rivUllY 
IIiuvc>rMit> of 

What aic Iho abihtK'fl otwculiul to the halvtiiK of ilic vanoviH <'\cr- 
ojsos coiifiontiiig the Dliulent of plane gcojoi'tiy? Hince iL jh poawble 
that those abililiofl may \)0 compnnenl imita of "general inleUigencc," 
aimlyaia of intelhgoncc teats might he llie meaiH of iletecting the con- 
stituent abilities. Accordingly, twenly-«i\ gioup intolUgonco tests 
(or forms) wore examined and their conlt'nt observed aa verbal, tuuner- 
iflal, or spatial in clmraclor. The sepuinle elements, and subtosla 
too, were annlyned Xuither into (J) abililirs to peiceive .singly (as In 
recognition of the name, size or location of an object), or to peiceivo 
several objects for the purpose of compaiisotis of similar or iion-siinilar 
meanings, shapes, or amounts (as in scaling to denote relative amounts 
of beauty); into (2) abihlios to recall word nieiimngH, allribiilcs, and 
relationships; and Into (3) nbilitios in purposive Ihmking: To discover 
relationship (as in ntimboi* series, mittlogies, and inixi'd leliitions, 
disarranged olomonls, completion of wmlences and inctuies), to judge 
the possibility and correctness of slateiiionis, to apply a piinciplo 
singly, and to weight elements (us in finding the best answer, the 
correct pathway, and in dealing willi certain elmneiiiH inferiuUially). 

Which of these abilities aic Bolecled and oigam’/ed into the senes 
of changing responses occurring during the [irocesscs of solving geo- 
metric exorcises? Perception is esscalinl; perception, in IciiiiK of the 
given figures as a whole or in parts, is dependonl upon llio locall of 
meanings of figures, of relationships, and of properties, i.c., a sufficient 
degree of meaning or familiarity with vocabuhuy units is nece.ssaiy to 
note and to follow commands or questions in Iciins of the total figure 
as given, or its parts, or tlio reJationship bclwecii those jiurls Not 
essential, but usually following this scries of perception.^ is Llieir motor 
expression in the drawing of the figure described and lu the staling of 
the facts given and those which are to be jirovcd; this combination of 
responses icsulta in pcicoption of known relationships in Lbo iiguic ns 
drawn, llccnll in the light of analysis means pertinent recall wliicli 
immediately makes available the needed meaning of ceitain figuies 
previously reacted to, or their nature, iclationships, or inopeities. 
Very ooraplioated is the aeries of responses, "purposive Lliinking/* 
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which IS to dcLcninno I ho hnk that conurctH tho conclusion — to bo 
judgcdi diawiip or proved wUli the rocallofl and analyzed facts. Tho 
more major responses included undcM' puiiJOHivo llniiking may bo 
indicato<l by these ([ueslioiis* 

Whieli elenienlh among reefille<l 'Mit in” with tho conoluHion? 

Wluoli elements among I hose analyzed in tho light of lh(» figure 
in’^ with llw‘ eonolusionV 

Winch on(‘H arming (lie pertinent lecalled eleineiils tlifTor from, or 
arc not included among lln* pmhnenl, analy/i'd facts? 

Is evidence avadahle to lietp in tiiiding Ihc one elonient neccBsary to 
complelo the nlenlily hel\MM*n the senos of analyzed and of rocallod 
facts? 


iS • ■ ■ - y Jt I 

'If adingoiml of a <iUfMlri]ulcrnl 
biflc(‘t4 tluHC angles uIiohi* Manning of 

vcrlnTS it joins, tho ilisgoiial hlulonH iit 

divnU’s Ihr figure nilo two [ ns a whole 
„cqunl triangles 


Hu 

Rn 


ffai 



Motor 

ExpreKHion /^j 


1 Iniwuig tin* 
figure. 

Staling \diat 
iH given 'fo 
he prov**fl 



idiif Perception of conelii- 
aion, that triangles arc 
ecpial 

Rii Perception of totaP 
figure, fKiUftdrilalcral,^ 
Hu Pereeptiou of relation- 
ahip l>elwecn parU of 
figure, diagonal hiBect- 
ing oppfiHite angUvj 
f^jl Pereejilion of hmiwn 
I relutionalnjiH in figure . 
In A A }U> and rUD, 
j Hu /I /2 (liven, 

I Hu / I (liven 
H{\ Ueeall m the light of 1 
I aimlyHiH J 

(Vnuiitioim for ecpial tri- 
angles 

- (I h) 

/^^(^ “ « - o) 

I Hu(h - r - fl) 


Ri/Rtt\ Wlueh eleiiM nls of //| and //i “ Wlneli elenient, or ele- 

\Ru/ “ill III” with /i^n? irienlsin ii*n<liffcrfrom ->Ht 

( Ru\ -yJU -*Hf those in Hi? 

'\\\(\ pjiirH of etpial nngli ‘S Irn hided Ride 

Hu/ ni A* I ami Hu 

'Does /!/) in Ad equal (Vuirlmnoh of equal limngles proved, 

727 RDin^Cam (u « n) 

Yi‘h, ”eomrm>ii.” 'hhurq llie i oiiinioii Hide, 7i/>, ih the unifying 

or link fmlor between tiie deaired, and 
giviMi and reealh d faels 


Docs this conijilotion <if llio identity between tliu two ttCMies of 
facts losuli in a unified gHiuping, cu olassificntion, oi gestalt” nf all 
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tlio facta concerned? Furthermore, dorn rerogniUon of flucceas follow 
the solution of the oxoreme? 

These nnalym‘8 are illuHtniU'd in Ihc I'xerriW' aliown on p. 005. 

Thoao analyses led to the conslruclion of a lest iirogiioslic of 
abililics m piano gooiiielry. Tin* silimlionH iind the leaponsea to those 
sltualions arc numerical anti verbal, as well an apulial in content. Tlio 
number and grouping of oleinenls are to Ii'hI the coinj)!e\, organized 
abilities and certain of their constituent pails, in onler to roveal the 
status of each student’s abililien m perception, lu recall, and m pur- 
posive thinking; they servo an additional purpose, nlso, that of ililTcr- 
ontiating between errors duo to cnrelcssneftH and to inabilities or low 
degrees of these abilities. The atudonls' slrenglhs and weaknesses 
thus detected may become the guides toward differentiated teaching 
emphases. The lest includes cloments m the form of ilirections to be 
followcdi detecting of similar figures, recall, di awing and judging of 
conclusions, detection of correct rciwoiiB from olafisifieil series of stale- 
ments for staled steps in geometric oxerciseH, and motor expression 
of spatial imagination. 

While this lest was being constructed, nnollier leal appeared— 
“Orleans Geometry Trognoeis Test.’’ Allliougli the purpose of each 
18 identical, the philosophy underlying the eoiiHtruclion of each and 
the nature of the content arc strongly conbasling. The jiliilosopliy 
of its authors (Orleans) seems to bo that prognosis of student ahihtics 
to learn geometry is best secured by student responsos to varied siiin- 
plings of geometric situations; i.e., that iirognosis of how students will 
learn geometry is by means of how they do learn when responding to 
actual goomotrio situations. On the central y, llic philosophy under- 
lying the tost (Perry) first described is that the more eflicicnt piognosis 
will bo effected by means of tapping the stuilcnla' potential abilities 
winch, when directed, can lead to oCfcctive inaslery of plane, geometry 
The “Orleans Geometry Prognosis Teat" rcquirea: detection of 
identical meanings, of named angles, of angle sistc, of complementary 
and supplementary angles, of relative angle and side positions, of 
equal angles and of equal sides and double lengtlis of line-HcgincntB; 
perception of stateincnt meanings duo to porce|)tiou of inaikcd equal 
parts; more dctootlon of “if" and “then" clauses; and puiposivo 
thinking duo to the soiootion of coricct reasons fiom a given senes of 
unclassified statements. 

Both tests were given, though in reverse order, to students in 
two classes in plane geometry in Lincoln High School during the second 
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someslcr of 1920-1930. tSmce Um* popm of hLucIohIs who wore repeat- 
ing tiic course or who weie nljhonteoH on one day could not bo included, 
thcic were forty-two Htudents whow* icHiionscs to the ole inputs of each 
test were sUidiod in doliiil and eoinptiralivply. In acldilion, there 
were two methods used for itieiiHuniig the aohievi'ment of thesi* stu- 
dents following Iheir a(u<ly of Hook I: One was tin* study of stuilent 
responses to Test 1 of "Halt's (leoinelry Tests, ’’ u lost which is a 
part of the legular class woik in this school; the other means weie tlio 
grades assigned by the class instruclois, although llio toacliers’ esLi- 
malcs of student achievement were influenced to some ovtont by the 
responses of those students to I In* Hurt test. SUidonls’ relative posi- 
tions according to then total scores on each iirognostic test, also their 
IQ's,* weio cluirled with (heir ucliievenu'nt positions indicated by 
total scores on the Halt test and liy inslructois’ grades Two tech- 
niques, tlial of Ihe Peiu>-on I’roduct Aloineiil Alethod and that of the 
Pearson Coeflieient of Mean Hfpiaie Oonlingiuicy, were used to ineasme 
the relative amounts of coirelatioti (hdeeleil by each of those three 
methods of prtignosiH and two melliods of deteiinming acliievement. 
The total r's are stated m Ihe lirsi part of Table I, the partial ? 's, with 
IQ's "parlialle<l out," in (lie seeond pait 


'I'AMI.h I 


Tuliil r'H lietuei'ii nictliiiilHof drier- 
luiniiig progiKiHis mid iieldevc- 
iiieal III geoinelry 


I’lirlnil i’h, (r's from 
wIiilIi K^'h liave liei'ii 
linrliidled ouC) 



IVrry 

OrlofUiH 1 

IQ 1 

Perry 

Orleans 

Grade 


JU 

m 

48 

40 

50 

Ilart 


Hi 

78 


.60 

42 

IQ . 


1 1 

70 





From these tables, and espeeiully fiom lli(' laller jiail of Table I, it 
appears tlmt Orleans' (esi iliaws Hie more lietivily upon intelligence 
ns esUnmteil by (he 'iViman (Iioup 'I'esl of Menial Ability This is 
noted from the diop of ,12 in tli<> mi'iisuiemeiit of the con elation, when 
IQ’s have been pailialled mil, lielwecn llie I’eiry lest and the teaeheis’ 


*Tlio IQ'fl, ulilmiii'd from llie files iii llu' olluo of lliu liigh Hehool, wrro drlcr- 
inincd by Ibo Teriniin (irinip Teiit of Menlid Ability 
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grados, and aimllarly a drop of .10 Orlcnna' tcHt and Umchors’ 

grado.s. When aclncvoincnt ih ddU-rrinnetl by llie aeon's on the Hurt 
teal, there is a loss of .07 in the partial "r" from the total "r" between 
scores on the Perry and on the llarL tents, Imt sunilnrly a much larger 
loss of .30 between scores on the Orleans and Hart tests. Furthermore, 
since the partial r's (.40 and .50) are, nearly identical, but the partial 
r (.58) 18 much larger than the partial r (.42), the Perry and the Orleans 
teats seem to prophesy achh'venient I'qually well tf achievement is 
estimated by tenoheis' grades, but proKiionm from acore.s on the Perry 
teat 18 the. more elTicient tf achievement is iiiea.surcd by scores on the 
Hart test. (Student time rorimicd for responding to the Perry and 
to the Orlenus teats was forty-five, and si'veiily ininutes, rcspeclivoly.) 

Ab the number of cases is small, further analysis of correlation, os 
detected by three methods of prognosis and two met hods of achieve- 
ment, was accomplished by niotitm of the Pearson Cmdlicient of Moan 
Square Contingency. Approximately equal proportions of the range 
of scores on the Perry and the OrloanH tests, and those ports of the 
range of IQ’s as used in tlio diffOTentialion of cIush members, were 
compared with the teachers’ grades,* ns interproled hy the school 
adminislratora, and witli the pulilishcd quarliles of scores on the Hart 
test; these appear in Table 11. 


TaBLH II. — STUOBNT PLAOBMBNT ACCOIlBIKn to I'uOOKOHIH ASO AeniEVBlIBNT 


Teat 

ScorcB 

Tcftchor’H grndrf^ 


Hurt fic(>r<>^ 



or IQ’a 



— 





— 



7 


4-8 

2 ] 

27 “88 

84 40 

41-46 

40-60 


62-77 



n 

10 


1 

8 

12 

Perry 

60-01 

2 

6 

6 

L 

1 

4 

6 

3 


42-28 

1 

2 

4 


1 

4 

1 

1 


80-140 

1 

1 

2 

14 

9 


2 

10 

14 

Orleane 

40-70 

1 

2 

0 

2 

1 

4 

5 

2 


8-30 

1 

2 

1 


1 

8 

• 

■ 


120-140 



8 

6 



2 

G 

IQ’S 

06-119 

2 

8 

18 

0 


{) 

18 

10 


70-94 

1 

4 



2 

8 


■ 


* The grades, (1 and 2, 3 and 4, 6 and 0, nnd 7) nro inlcrprptrd in per rents (in 
the nintiea, eighties, sovontiea nad below aovciily, or "fnilurn”), rcBpeclivcly 






noo 


Tho Pearson Oo^'Hieients of Mean Srniare (loiilniRcney,* eompuled 
from Table H, are HtiUcfl m Table Hn {The ninoniUs (tf lliew eoefn- 
cicnts could not exceed HIJO *) 

TAIlIiB Ilfl ' f'Vs IIKTWBB'J PliritiSOHtM AVIl Al ItO.V/AOM' 

1 IVrrv j nrli-ntiH j 

Gvadf! . . I ' 11 . (11 

Hart j ’'■'I j \ h'l 

Tho (iilToronceH ItiTween (he f,Vs ((f the I’erry Kcoren mid (he jnciisurcB 
of achicvcmeni, and (lie conexpondinf? CYsof llm OrlemiK semes and of 
tho IQ’s, range from - 12 (hiougli .11(1 to .12. Tims, all liimgh there i« 
association between eaeli melhod of prognosis and of aehievemcnt, no 
marked supenorily in tlieir nieusiiremenl wa.s hIiow n by any one of the 
techniques used 

In conchiBion: PiogiioHis of abihlit"' to solve e.xereises in gisiineliy 
seoms the nioie efiieieiif, wlieii ba''ed upon aiinlvu.s of the reipn-siLe 
abilities and their eonslituenl pailn This iiinmsof piogiio'^i.s (Perry 
test) not only requireh less eliideiil fiioe but il also tliiplicalch less (hose 
abilities interpreted by (lie Ki’a, lliiin does (lie I )i leans lesi. Scores on 
the Perry (leoinelry PiogimsiK Test are jiroving uidieadve of sludeiit 
status 111 ncliievemeiit, and fiiillimiiiore of nifoimadon eimeerniug 
aUidenl Htrmigtlm and weakni‘S‘<i h infminalion of paianimiiil iiiipoi< 
tancG 1(1 the teacher wlio in lo dneci the learinag of (he aliidmila of 
plane gcoineliy, 


* Tito ((‘rhiiii|iie fur (oinpnOii^ (lies' isii (In leiil < ei ribfii in "An Iiitriiilnc- 
tion lo the Thcmy of lSl'lll^t^l'H" hy (1 tsijiv lule (|ip, Ull (17), (ilvi m "StotislieH 
m P8ycliul()f;y mill iMlni Mlnm" li\ ]Ii'iir> 1'^ (liirn ll (]i|i I'.I.I 'JIM) 



THE DEVELOPMENT OF MENTAL AHirA'PY AT THE 
COLLEtiK-ADIU/L' LEVEL 

MIXVIN U. WJIKJIIT 
llniN^i'rHily of I’chiiHylvnuiti 

It we intty define beluivior iih ihe reMponm* of lUJ or^^uiuHiii lo a 
atimulua aitimtion, it in pohSiblo lluil a more comiilelo koowlcdKo of ilio 
orgaJdflni, may enable ua to moke more uccurale prodiclions, with 
rcBpcot to Bubsequont behavior. EKpcncncfi baa ahown that Ihcic is a 
high degree of correlation, between the Htatuu of menial development 
and the quality of the pcrflonnhty prodiicla. 

Moat of the investigations of Menial Ability, have been confined lo 
ages ranging from three to eighteen yenra This is pnrlinlly due to 
look of materials and inctliods for iuvcsiigaling the mental growth at 
the Iiighcr ago levels. Furthermore, wliilo it has been generally 
assumed that biological and environmental fiielora liolli conlnbulo to 
mental development, but little progress lias been made in analyisiDg 
the contributions of either. 

The present investigat ion was imderlakoti, in order lo determine 
what progress was taking place xn menlid development, at the (-'ollogc- 
Adult Level, an ago range from eighteen lo twciily-llireo years. 
Secondly, wo propose to analy%o tins nicnlai growth lu such a way as 
to reveal the relationship liolwcon its biological aspeclH, and those 
which may bo attributed, more directly to onvironmoiilal [nessuros. 

Term an has pointed out that though the Ihnel scale docs not 
properly evaluate children who lest at one hundred thirty, beyond the 
fifteen year age limit; Una “does not mean that dovolopmcnt ceases at 
this tlmo, but merely that the Stanford-}! mot does not measuio it." 

Thorndike gives a parabolic curve, resembling the Iciuning curve, 
rising rather abruptly from six to fifteen or sixlcoii yeans and then 
approaching a plateau which he desciibes us, " tlio prolxalde form of the 
curve of intellect m relation to age.”* 

Thurstone has shown a mental growth curve, liasod on Uiiiot test 
data, for ages thico to fourteen years, coiicoining which he says, "A 
striking feature of this curve is that it continuos lo riso ovimi at Uu* ago 


1 Terniftn, L M . "The Intolligonoo of Scliool Childron ’’ P. 147 
* Thorndike, E. L . "The Mcasuromcni of Intclligciicc " P C 
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of fourtcoii ycnm, willi no imfir-ition of loacliinR a level. It cerliiinly 
looks 118 tlio llie knul hUi llineiice which i.i ineaimcil by Ihnet tOHta 
an<l tlicir vtuialioiiH, coiil nines to >?i(nv as rapidly at fmirleen yeaiH as 
it docs at nine Tins c()iichi‘*ii>n coniradirls the HtaleinenI fre(|ueuHy 
made, to (heelTecL that test nilelliK''ncc upproaehcH an adult iincl iiioie 
or loss stable level at fourteen (o .sixteen years Tlie appeaianci' of 
these cm ves, indicates that (he urowth of lest mtelhgonee continues 
beyond (he age of foiiriei'ii y'enrs . . . ('oiniaon aeiise judgment 
certainly favors llie assiuiiplion l hat the iiverui'e man of forty years la 
more intelligent than llie average hoy of twenty, hut so far we. have not 
been able to ineusure that di(Ten>nee. Instead of acknowledging this 
limilalion in our nieasunuiienl iiietliods, we have, not infreiiucnlly 
attempted to juggle with the delinilioii of intelligence, to make it lit 
the nica.siiring devices thnl are aeis'ssiide 

There are three curven in (he graph to winch Thuislone referfl, all 
approMinaU'ly parallel, one of wlneh represents the mean idiilily of 
SUCCOS.SIVC age giniijw fritin three to fourteen yeai.s on Hinet tests. 
The second represents tliosi* who had a plus one sigma rating above the, 
means of thoir respective age groups, and the thud represcrils (hose 
who had a imiins one siginu rating, below (he mean for tlieir lespeclive 
age groups. All Ihese einves sliow a eonelatiou of heller limn 97 
botweon lest ability and age. 

In a later arlicle, ThiirstoiK' has extended tins curve, liy using 
similar data, for nges three to soventeen yeur.s, and inierpolalmg (he 
curve buck to birtli. The mam pait or ceiilial extisiHion of the 
original curve, from lliiee to fourteen years is slightly modilied, ho that 
in the later cm vc, an itdlcelimi points develojis hetwi’eii llio mnlli and 
twelfth years, jiussihly ahont the eleMsilli \ear. I'roni birth to (he 
third year, (he curve .^howH positive ai’eeli'ralmn, wlneh emilmues to 
the olcvciilh year, wlnle from (he fouMeenth to the eighteenth yeni , the 
acceleration becomes uhoiil eipialh negative Tins curve is shown 
in the diugroin atlaehed to this jmper 

Thurslone concludes that tin' mental giowlli emve is asymptotic 
both to absolute zeio and to iiii adult level The lower limit, is eslah- 
hshed at — .‘III at birtli, (he upper hunt is not aseertunmhle liy eniiipu- 
tation. "Tliese (iiidmgs emiliadiet the h^ pntlietical m(‘nlal growth 


' Thurflloiip, I, L. A Metiuiil <■( •Ssiliiig l'rt>elMiliiKieii) Tiols ytmrmil of 
Educalwnal Pityclwlngi/, Wt)\ XVI, Nn 7. |> 112 
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curve of the text bookB, which ih ummlly flhown to have ncf»ative 
acceleration from birth without un inllcctiim piunl.*'' 

The presoaL invcHliKalioti ntlcinplH to iiicaanrc llie ilevclopmcnt of 
mental ability that lies licyoiul the range of Ihiiel scali-H, aa reported by 
Tburstone. It further seeks to aacerlaiu whet her inentnl devcbimicnt 
has reached the plateau Hluge between tlie agea of Hevenlceu and 
twonty-lhrcc, at the Colk’Re- Adult l/'vol. 

Thurstonc regards his secoml mental growth ourvt*, as giving a 
"better picture of continuity for iiituilal giowtli regarded ns a biological 
function." In pursuit of wmilnr informiitioii, we have clKiseii a battery 
of tests, which we believe will give at» index of the continuance or 
decline of this biological pliuac of mental growth. We have cliar- 
aoteriKcd this phase as Funduiuental Aliility. 

Wc have niso cliosen a second battery of teats, which will evaluate 
another phase of mental growth, which may be dehiied us Complex 
Mental Processes. 'I'bc former may bo constuiod as concomitant 
with biological growth, while the latter represents the elTccL of edu- 
cational and cultural pressures. The snmo tests were, presented to all 
ages from eighteen to twcnty-tlirec on llie assuiuplion that Ihoic was 
equal competency within the group. 'I’lns UHKumplion was justified, 
In that all ages scored jiractically over the same ningos, m all tests, 
with varying degrees of frequency. 

The results wcio obtained m the pHychological laboiatoiy at the 
University of Pennsylvania, from college men and women, dining the 
three academic years, 1927-1028-1029- IPHO, u« part of tlic required 
work in psychology courses. Tins toslmg program was instituted by 
Dr. Lightncr Witmer, and lias been dcvclopi'd over a number of years, 
by instructors in the clinical laboratory sections of lirat year psychology 
courses. 

The tests, to which the students wore subjected, wcie Used as 
didactic experiments or detnonslrations. Tlicy wcic administered 
under standard conditions and procedui'o, during the course of twelve 
class sessions, by a number of instructois, and scored on established 
standards. The significant measures for each tost weio donvod fi om a 
combined protocol, of the various groups that had taken the to, sis. 
More than eleven hundred students liave been lobtwl in this niaimcr 
during the three years, and have contributed to tliosc reBulls. 


‘Thurfltone, L. L.; The Montal Growth Curve for Binot Testa, Journal cj 
Edvcalional Psychology, Vol. XX, No. 8, p. 600. 
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Dr. Broteinarklc, luiilt'r whow HupcrviHioii llifw rour/w'S w(‘r(» 
given, conceived the idea of iieiiij? (he eeon'.i (o develoj) u "M(*ntul 
Graph,” by inenriH of winch \tirKiu.M typi'H of hlndt'nl abihly iinglu he 
portrayed graphically.' Giie of tlie ((isdiietive feafiircH of (hm Mi'iiliil 
Graph, ia the annlynia of Mental Ability into two p)ir(«, wliieli he 
designates na: (1) Fmulainentai Atnhtiea; and (2) f'omplex Mental 
ProcGsacB In evaluating any peihonalily, or itn jiroiJiietM, it ih 
manifcatly of gu'at inipoitanci*, from hofli (he diaginistie and prog" 
no.slic points of view, to Know whether an imlividual’s inferiority or 
superiority, can ho Irueed to either one or (lie other of (lir‘‘e (woiispectH 
of his Montnl Ability. Meiixiireineut on the Siatiford-lhnel, and oilier 
group or individual tests, affoida no such iii‘.ighf 

The pragmatic vindication of tins proreibue is evidenced hy the 
types of graph aeluallv ohtaiiieii in prnctiee, winch Dr. Droteniarkle 
divides into the folloiMiig seven olaxM'H, 

1. iS’uporior meaning superior in iMiadamental Ahility and in 
Complex Mental l’ioi>e‘.xes 

2. .Siipoi'inr doHoetidiiig meaiiing sttpenor In Furidatitenfal Ability 
descending in (’onipleN Mental I’roeesNea 

3. Median aaee/iding meaning nndnin In iMimlameiital Ability 
and ascending in ('oinpl'‘\ Menial Proof ‘c.es 

4. Median meaning me<han in l-umlamental Ability ami ( ‘mnpk'i 
Mental Processes. 

a, Median de.sct'ndtng nieamng median in iMimlamental Ability 
and ilesconding in (‘oiiiplex Mental rrtioesM-’j 

0. Inferior a‘(oen<lmg meaning inferior nt iMimlaineiitid Abiliiy 
and ascending in {’oiuplex Mental Piooes'-os 

7. Inferior meiimng m/eimi in botli Kiimlamental Ability and 
Complex Mental Pioeessos 

It is by no nieiin.s ineviiidd}* insured that on indivnliial iiitli a 
superior cndowinenL of iMind.imental \hility, will pm force Koiiaiii 
superior in tin; held of Ciiinjih'x Mental iVoee‘-es Xoi is it asmired 
that a median cii<lo\viiieiil of iMiiuhtnienlal Abiliti , ina\ not rise or fall 
in the field of (‘omplex Mental Pjim ('‘'‘•eH hrmn these (milingi., i) 
became apparent llial any estimate f»f the giowlh of mental idulily 
at tho College-Adult Level, jiiiisl Ins aiinl} /ed, not only with le.sjiiei 


' Broldimrklo, U A’ Colli ge .Stiideiil I'eisonnel I'riihleiiiH yimtiHit I't 

AftpUed Pgycfioloffn, Xf, Xu <1 
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to jiicronHiiif; afto, but olw) will* tr.><iM’cl t<i tlio clcvflopinonL of these two 
plioscs of iiiontul (ibility. 

Our invoatigftlion conceniH the urlneveinnUH of (ho vnrious age 
groups from Hcvcnlceii to Iwoiilj'-lhnM-, coinprimiig llio (’ollcgo-Adull 
Level, jn these two fields of Moiiliil Ahili(y. In forming the ugo 
groups, each one wn« iimdo to irichido nil iiullvichml.H who had paused n 
given birthday, but had not passed the ago level of I he lUfxl higher 
group. Thus the eighteen year old group enniprises those who have 
passed their eighteenth birthday, but have not yet reached the 
nineteenth. 

The results obtained by the seventeen year old group, aic not, to be 
regarded ns highly significant, owing to the very few eases nvuilablent 
this age level. The Iwonly-threo plus group, repri’seiits a small 
miacellancoviH company, ranging from Iwenly-direi' years to us high 
ns 40 years. Their helorogeneily luul limited numlier pliiec a high 
degree of umeliability on the resuU.s oblnmed by them. 'I'hcsn fads 
must be constantly Imrne in mind, when reading the extreinilies of our 
subsequent tabulations. 

More than ele.ven liundied students were lesled, though not all of 
those look all of the tests, due to abaeiiees and interniplionH of Ihclnbo- 
ratory sessions. From this ma-Hsof iiiiileiial, we lind nvaihible, between 
six hundred and seven liundrecl scoies for eiudi test, iiliout equally 
divided between men and women. The hpoioh were gioupcd in resiicc- 
tlvc piotocols for each age level A subHequeiil invoHligatioii of llicsc . 
results will be conducted, on the basis of sex, to asw'rliun what differ- 
ences may prevail between them, 

Wherever wo had a scoie, belonging to an iiulividmil of a pnrticiilar 
age group, it was recorded, regaidles.s of how many of llie twelve 
tests, the individual may have missed Our final n'sults uio therefore 
more significant, from tho point of view of achieveiiienl in lelation to 
age, since the results of no two tests, include scoies liy exactly and 
exclusively the same individuals. Nearly all tho students took almost 
all of the tests, but some who look tost number tw'o, for exuniide, may 
have missed tests three and five and vice verm. Tho resuUs iheiefore, 
arc based on scores, belonging to certain age gioups, lalln'r than lo 
corlam groups of persons of a given ago. 'I'liis factor disiiols, lo hoihc 
extent, the possibility of a fortuitous sclootion of HubjoclH Ouis is a 
random sample of the College- Adult ropulution. 

Following Brotemarklc’s analysis of Mental Abilily into (ho com- 
ponent parts of Fundamental Ability and Comjilex Mental Prooess>cs, 
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the si’t teats which were useil (o ineusure eucli one of (hese factors, in 
this invest iKUtion, lire listed lie low. 


I'USUAMnNTAf. 

Namur tir TisRtfl 

1 Memory Span ff»r DiKitw 

2. Memory Sjmn for SvHnMiw 

3. Memory S|mii for hU nn 

4. TrtyJor Nimiber Tcjat 

6. AuBsage (UmliriTlnl AUenUoii} 
6, Auflfrngo (Djrert^'fJ AtUmhon) 


(f^Mrirx MnsTAi^ Pbim 
NAUitA rir 1 unTfl 

1 (ttobark) 

2 AbKlmelmn (Uohnrk) 

•\ Hefi n IH e (Uolprtrk) 

■i JVliintion (IlroteinArklo) 
5 Jufiginent (Itolmek) 

I-rAOKUAge iScaJe J 


These teals liuvc been (ircsentod imltvidufilly by Ihor ttuthors nad 
subjected to unalysis by firoiemurkle,* and MiUcr * It is sufliciont to 
indicate their Renorid cluiraolenslicH mul the difTorenccs between the 
two batteries 

The battery used for eviilimtinK Fundninciitiil Abilitie.s, flecks to 
ascertain the relative ]>laslicily of the oigaiuzcd jirotoplaam, its 
Impressionability. The ineiiiory span tesls ate alninsl ns simple as the 
patellar refle.v, but liniits of acliieveitieiil vary with the individual, as 
docs the excursion of (ho fool in the knee jerk The lemainiiif]' three 
in this battery, arc used lo explore the lield of attention. Is the 
individual alert and leoeplive lo (he world about liim? To wliat 
extent does the worlil intrude ilself upon bis personality, and make 
impressions upon him. 'I’heM* lliicc oR'er another clue to (ho iiidl- 
vitluttl's plasljcily. Ins impiossionability, the ease or difliciilty with 
which he can be modilied or udjimled lo his cnviionmcnt. 

The tests for Complex hfenlal Pioce‘i>,cH, invcsliftato a dilTcrcnl 
aspect of meulid function in perflonality Ileic we ob.se,i ve and seek lo 
evaluate, Iho influence and icsuUh of lininniK and enviionincnl, the 
height of the cultinal level, the cleauiohs or obscuiity of thougiit 
processes, the powci of abslrucl ibougbt,, the ability lo coiihlrucl and 
compaie conce|)ls, koenneh.s of discnimnalKm, tlie pieciaion with which 
one may describe or dehne, and so on. The whole range of complex 
incntni functions m peisonnhly invites onr inquiry, but at best, we 
can only select a few samples in the diieulioiiH indicaleil above. 


I Brolfltnnrkle, 11 A.s (Jollent' Stiiilenl IVrmmiiel ProlileniH. Journal of 
Applied Pftyrhologp, Vo) XI, No ft. 

•MiDor, Kiirl (1: Ttio tkimpoloacy of Fifty Collego Hliidenta The Psy- 
chological C'itritc, Vol XIV, Nos. 1-2 
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We have Ireated llio rcflulls oblnined I»y Iht’Ho two IjatLcries, 
hoparatoly. The ecorcs lor ewclj test for rerli UKe Kroup, were tubulated 
uud llio avernKO and BiRiiia <lclenimH;fl A conipoattc Hcoro for each 
ugc group, for each buttery, wus then developed. Them' coinpoHilc 
scorcB aic known aa the Tundanienlnl Aliihly linlex anil the Complex 
Mental Prooctiaen Index. 

The method of obtauiing (hew eompjialte acore.s conHinled first 
of all in weighting each of the aix (eula of eueh buttery wpuralely. 
The amount by winch onch teat Hhoiild be weighted waa detornnned 
by Iho ratio, wliieh its sigma bore, to (ho uverage mgina of the six tests 
in the battery. Thai is, llio iivernge slgina of llie, six tests, was 
divided by each of its conslitueut sigimia, and (he re.siiltmg quotient 
was tho weight olioson for that le.st. The mean of eueh test was 
raullipheU by its lespeclive multiplier; the r<‘Rulls miminaled, and an 
average mean for tho six tests derived, forming a coiiiposilo score or 
index. 

We have designated this statistical pioeediiri' as tho average sigma 
method of weighting or combining to.sL scores, lOach of the six 
constituent elomonts of the couipomle mean, boars llie Hume mivtho- 
matlcal relation to tho original from which it was derived, that its 
respootivo sigma bears to tlio average sigma of the liallery. 

This method, oltercd iv consistent scheme, for treating many 
combinations of scores in both batleries, and further (diminalcd the 
possibility that obtained lesulls might have been inlliienced by a 
fortuitous choice of weights for the various tests. These imliees wore 
then subjected to the statistical analysis indicated in the (liscussion of 
results. Correlations wore obtained by the Pearson Pioduct Moment 
Formula. 

A method of combining lest scoiea, somewhat similar to that used 
in this investigation, is described by Garrett.* Tho "Chance U" tor 
multiple Correlation, was obtained by the following formula:’* 

“Chance B” = 

y/N 

t ANAIiYSIB 01' IIkBUI/TH 

■Tho moans attained by tho various ago groups in tho tests which 
constitute tho battery for Fundamental Abilities, iiro found in Table I 

‘ Garrott, II, E.; "Statistics m Psychology mul Iklucnlion.'’ P 280 

* Garrett, H. B.; "Statistics in Fsycliology and Educalion," P. 230 
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In 08 much fl« the poiiuIntioiiH of the* vnriouH a^c groups differed con- 
sidcrnbly, the ^renter propoifion of tiialhoniaticnl rcliabdity belongs 
to the group imving the inigesl iiopululinti 

The BCorcH of the Heveiileen year uge group, have been discarded 
in subsequent ronijnilatioiiH, bcenuHO ihejr suiidl number gives an 
exceedingly high degiee of uiuehubdity to these scoreK. Furthermore, 
tliey represent « liighJy seleeled group o( ijidiVKlii/ilK, who by rensoii 
of an early start, spi'cml leaching, ability to skip a grade, or some 
other reason, readied the thuvcrsily liefore their oighleenlh birthday. 
The size of this gioup aa coiiiparetl with the eighlecn, nineteen, and 
twenty year group, ludieales ihiil hdiiio factor of hdeclion was at work. 
If this factor huppeneil to lie superior uienlnl ability, this marka them 
all tho more aa ii luglily selecti'd group of seveiUoen year old indi- 
viduals F'or our iiurpo'-es wo need rniidoiii samples of all ages 
investigated, in Huflieieni mnnbers to give some degree of rolinbibty. 

Tho group listed as Iwenly-tliree plus, lepicsents miscollaneoiis 
ages as high as forty and ih iberefore not indicative of any age. The 
scoreB of the twenty-two year old group liave heen used, though they 
number but twice tin* size of the seventeen year old gioup. However, 
they do not iiuiicnle that siieeinl fuelois contributed to Hioir selection, 
which wore not also upplieabh' to ages eighteen to twenty-one. Never- 
theless, due cniiHideialum must be given iboir fliiiall population in 
cvalutvlmg their nuheea. 


Tadi.e I— SaowiNo TUB Avbhadk and Ktandaiid Dbviation von Each Aio. 
(iiioiii’ IS hiNDAMhSTAi. Ami.mi.n 
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Table I gives little indiciilion of the relative abilities of the respec- 
tive age groups, by observation. 
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Tiiblc II hIiowr It) Riiii)l»r (hi* ntciiiiH iichit'vod by the 

various age groupt hi tin* IpaIk (’oiitpriHiiig ihf, bullcry for C’oinplex 
Menial ProceasTK. The rewuha (bi nol greuilv fiK'ihlulf I be tliflcovcry 
ol Lrcncla in mean abihly or vnnnhihiy, Iiy obxervution 


Tadlb lII.~-8ttowiKo TUB CoMfOKrtB AvBtiAuB N'diiJ. Poa Mai ‘11 Aoc Ghodp 
tH FnaiiAUi'.srAi- Amii.itiim 
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Table Itl shows Lho ri'sullH of coiulnniiiij; llu* six Fundamental 
Ability test scores, into a compomlc or indexj fo) each gioup. The 
eighteen and nineteen year old grotipH a|i[i(*(ir lo ho Hiip(’iiof lo the 
twenty year old group, and the twcnly-ouc aiid twonly-two year old 
groups aro also superior to the twenty year old grou)). The nverago 
ago of this entire CoHcge-Adult Level, weiglilerl aceording to the 
number of each population, is 19.69 years, while the average mean for 
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the entire f?roiip in 14 03 in FunflamciUul Ability, The mean ago of 
this group of C-'ollogfl ndulfn (liercforo lica between nineteen tmd 
twenty years, wlnlc tlie mean ability of the college adult i» represented 
by a score that is closer to (he scori' of these two ages, than it is to that 
of any other age group. 


Table IV. — Huowivo tub Covii’ohitb Kcouk ron BAeii Cbioui’ in CoiirLHr 

MBNTAf. I’nOCEflSEH 


Ago 

I'^rcquoncy 

Mcail 

18 

OH 

'13 84 

10 
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46 38 

20 

18, *j 

40 35 

21 

03 

47 20 

22 

33 

47 09 


The rcsuUfl of comliiiifd scores for llio (/'oinplox Mental Pjocoases 
are shown in Table IV, Here the. trend toward increasing ability with 
nioicnsing age is more readily observed. The hiko of the means for 
Comple.x Menial Processes as compared with the siisc of the means for 
Fundamental Ability m not indicative, sinee thchc sizes ropresont the 
arbitrary nuinoncal values of the reHjicolive scales by which the teats 
wcic guided. 

The coirchitiori of Fniulaniental Ahildies with ago is + 17 with a 
PE of + 02.'). 'I'hih represents a l<jw degiee of correlation, yet when 
portiaycd graphically, it loveals some significance The coi relation 
of Complex Mental Piocesses wi(h age is + 95, witli a PE of + 003. 
The Multiple corrchilion of nge with (Fundamental Ability and 
Complex Menial Pioeesses) i.s d- 97 with a "Cbance 11” of + 050, 

The compui’iHon of the respeetive tieiuls indicates, first of all, that 
these two haltenes liave lupfied two thffeient kinds or phases of 
ability. One of these we have defined as native endowment, Eunda- 
mcntal Ability, or menial growth eonsideied as a biological function. 
The olhci is defined as a liighly complex intclU’cUial rcBponsc to 
educational and cultuial prcssuies; ic. the development of Complox 
Mental Processes From lliifl point of view, mental growth at the 
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hiRhcr mtdU'climl icvHs I* m ttf n function and more 

of ft rcHjKHiw to wU’fU'd cnviroinnt ritiil |irrf*.hiin'f« 

It niiiMt Ix’ rxralU'd tlial we iin* cli almK with a I'hnuiolof^ical period 
rangihf^ from ciglik'cn throue,li Iwcntj-two yrtiv*, hciirc wlmt maybe 
Irue of lUeKO twriiculur aRCt*, may n"i In> trui' uIkivc or hclow llwm. 
Until now, tho n>rrcI(ilion inontnl Rrowdi and iiRO for lItU 

period li«« lM*<‘n itHHUiiii'd ii« rero, wliirU woiihl kuc hh a plalrftu on 
the ourve. Hy iicHia) ni<*aHiir<‘nu’Ul, o( tin* corn lalioii, ac have found 
it to he wliieli Rivcft u irnidiial incline npwnrd toward umtitrity. 

'I'lie. trend of (’oinidex Mental Pmecw'H nhility, riWK from uiRlileeti 
to twenty-two yeara, with n .hHrIiI drop of 1 1 at tliia lust ataRe, poHsibly 
due to the Hinall iiojnilation at thia point. Incn'aeiiiR iirc, lived under 
the atirniiUis of eidlural niid cducaliomd etivironinciil , has provided a 
more cxlciipive orienlalioii, u richer haelvRroniid from which all mental 
function produclH may he derived. Tlie fniilH of added years of 
experience are nmnifcHl m the Irmul toward urcaler uhilily to mnke 
highly complex responaeK will) increasing age 

In order Vo jnemnit Vheso correlaliona gruphieully, the slopes ot the 
regression lines were determined hy t li(> formnln : 


whore M represents the elope of the regression of (1) l-'niidiinieiUnl 
Ability on age and (2) of l’oiiiple.x Mental I'roccHseH on age. (i 
rcprosoiils the mean of either nrruy of ability iiuhcim, and a lepiesonls 
the array of ages, x and y represent deviutions from llio means of age 
and ability, reepeotivcly. The sum of these dovialioim is determined 
by the size of the populations in each group 

The regression of Fundamental Ability on age gave a coclTicicnt 
of -p.OO and the regression of Complex Meiiltil PiocesHe.s on age gave n 
coeffioienl of -f.O'l, Further reduction of these values to sigma or 
atandard units, fftcilltaled their rcproscutation on llu* same graph. 
The formula In either case hcenmo; 


M, 


Mi 

a 


where s moans “standard units” or “sigma units" and cj, m the sigmn 
of the array of cither ability taken separately. This gave ( he slope of 
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the regression lines in terms of Hlnmlard units, thnt for Fundamental 
Ability became y “ .iria"; nnd that for Complex Menlnl Procossca, 
y = ,93x. 

The Hlniulard Ivrror for the Cocirieient of Hegrcssioiv is obtained 
by the fonmila : 


<7 




II 


<r^ ll -• 


where tea is l)>c sigma of the age army,' r w ()u> cop/riciout of corroJalion 
between ability and ago, and A'^ the number of cases. 

The Slaiulard Krror of (h« Cioeflicicnt of Regression, of Funda- 
mental Ability on age is foun<l to be d-.OlS, and that for Complex 
Mental ProccHses on ngo is found to Im -1- 012. 

The values indiculo Ural of all, the higli degree of improbability 
that these two curves (1) and (2) can ever change sulliciontly to move 
with the fiiiine degreo of ncoelenition, within the range of eighteen to 
twonty-tlireo ycius, thus finmshing adiled uhsurance, m terms of 
increased prolinliildy, to any conclusions justified by these curves. 

TJic JiniilsKCt upon (lie Hlope of the lAitidnriictitiil Ability curve (2) 
by its fllamlard of eiior, indieulc (huf (here is but very slight prob- 
ability llint the mental growth oiirvew ill icacli aplatcnu during this 
poiiod. In other woid.s, Dieie i.s I'xceedingly liigh probability, that 
this portion of the curve will always use slightly, mid furthermore, 
that Us pi'osont location is the most probablo. 

In a similar maimer, the probability that tlio Complex Mental 
Process curve, (1) will evei reach a plateau during this poiiod is even 
more remote, with the stioiig presumption that its present position is 
the most iikely, for any rnndom sampling at the College-Adult Level. 

Dingiam I is a grapluc piesciUatiou of these results Our pioblom 
is to reconcile tlicso, two difTeiont aspects of incntal growth. It is 
evident fiorn iSeclioii 2 of tiio cut vc, that the liilherlo ns.sumed plateau 
was relatively lliough not absolutely correct. Tliafc tlio curve is 
approuchiiig a plateau at age hovontcen is certain, but that this 
plateau lies bi'yond twoiity-lbrco is also corlam. Fundamental 
Ability, niittve endownioiU, is still slightly on the increase through 
the twonly-HCcoiul year. 

Section 1 of the dual curve, ichoinblcs very much the curves 
obtained for test ability correlated with ages eight to fifteen on the 
National Intelligence Tc.sL; also thnt fioin eighteen months to six and 
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oiu> half yosiratiu Iho Sluliiriian Trpi. rjii.l liKtl from lo sixlcca 

yearn on tlie Cliin Advaiin-d imj-lliK* im '' T«‘>t ' Tlic rate of Us 
acceleration »» in Mtarp confr^^^l ailh I lint of Hci'luin 2. The relative 
height above Pecliou 2 ia Inwumriennl , n» Ihta wna nrlnlmrily 

chosen witli rcaiH'ct to ollu<r features of the diuil curve. The rclallvo 
alopc of these two ciirvcB j« tin* Hgnifirdiif fnrtor 


% i i 9 f 4 *JeMA MN(I4 



Curves showing llio rolntlvo elope of (ho RogroiMiluti Lines < from Agoe oighlccn to 

i'rt onVy-lhroo. 

1. RoKrossion of Cotnploi Moninl Proccenes on Ago, oSKhteon lo only- three 

2. Bofiroaslon of FundnmonUl AbilUioa on Ago, oighleen In twenty -threo 

3. Thoretono Mental Growth Curve from roro lo eovnntooii yenr/i 

4. Tlieorotloal Curve of Complex Montnl ProccBs Doveloiunoul, lioro tu Bovontcon. 


It would appear from the sliapo of Seolion 2, ilmt llu« niUivo endow- 
ment or monlal growth regarded an a biologieiil fimelion, ih faat 
approaching its maximum between eighteen and Iwenty-lhrce years. 


* Thuretono, L L; Tho Abaoluto Zero iu InlQlligoiico Moasuiouient. Psy- 
chological Renew, Vol 36, No. 3, May, 1028, p 103. 
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On ihe other ))nn(J, llic uilrllecf tin) cJiivelopiiient niid cultural status of 
this sftine Kroup, conliaurs to riw projiorliouaU'ly to Ihcir continued 
aubjeclion to cduculionnl and ciiltuiul ouruculii. It BCcniH rcnsonnblo 
to ohamclonzo KecUon 2 as iiulicnlive of mtlicr oloitKoilary mental 
behavior, and Keclion 1 ua indiralivi* of rallier highly complex mental 
behavior. Wo hIuiII jiroljahly avoid Home cnnftiHion in diHcu3.Hiou by 
onilttifig iho doubtful iJiferMico lO “intelligence." 

A further chnructori/.ation, which difTerenlialc.s thcae two tyjjcs of 
mental growth, might rcgaul Hection 2 iin the evolution of the inherent 
qunliticB of the protoplasm a Hiinple hehavionstic estimate of mental 
growth. The other curve, Keclion I, roprcBcnlB no denial of the former, 
but reveals a Bupplcmenlnry asiiect of mental function m personality 
development, wherein the cultural and educntlona! Jiifluencos of 
society arc innmfesl. This curve shows a much higher correlation 
with chronological age. Kince these two types of behavior arc pro- 
duced by the same biological orgiinmiii each as inevilablo as the other 
— it would seem lliat every Htumilus situation offered an opportunity 
for selcoUvc reaction or choice of muntiil function. Wc may react 
biologically, at the anininl level, or wc may react na iiUollcotual 
personalities at a higher level. Perhaps llio greater degree of employ- 
ability, tends toward the lughia rnther than tin* lower level, tvt tho 
Collogo-Adult Level, especially if we have regard for the pro.9ont value 
of correlation coedicienis. 

Our next problem is to relate our lesuUs to provums invcatigutioiiB 
of mental growth On the basis of the icsults obtained in this investi- 
gation, we liavo nltempted to interfiolnte botli *Sections Z and 2 of 
our dual curve, linckward to birth. 

Wo have accejited the menial growth curve of Thurslono, from 
three to Bcvcnleen ycais, as inost nulicativo of this period. Without 
modification of either curve, oui Fundnnieiital Ability curve, Section 
2, appears to bo a continuation of Ins hiulings With some degree of 
confidence, the ctnve for mental growth, considcied as a biological 
function, can now Ix' diawn fioin birth to the twenty-third year, 
From the shiijie of 'I'hm. stone’s ciiive (3), it is cvulcnt that the rate 
of this developmental piocess is not conslaut It has a positive 
acceleration to approximately the eleventli year, wheio it roaches an 
inflection point. 'I'heie iiegulive iiccelciation nets in with steadily 
increasing awiftness until wc leacli the hoventecntli or eighteenth year, 
at which point it appears to enter upon a period of constancy through 
the twenty-second year, This tyjic of mental growth increases as 



624 


The Jnurnnl of Eilurnhottnl PajfcholoQif 


much or more m any miiKlo year, bclween seven and fourlcen years, 
as it does durjnf? tire wliolo five year period fioin eighteen through 
twenty-two. 

We have noted the similarity irelween our {'omplex Mental 
Process curve, Section I , nnd the curves derived for other ages on the 
National and Otis tests. Wo have nol. I'lideavored to iit our curve 
to any of tlicao as yet, though we propose to make this iiltenipt in the 
Buhsequont investigation of our results on (In* Iuisih of aex. For the 
moment, wc have placed our (hunplex Mental Proci'ss curve, Section 
1 on the chart lu an arbitrary manner, pre.^erving only its relative 
slope, and Iheorclically extending it lonurd rero alnlity. We have 
designed that it intercept llic Tluirstone curve at the eleven year point. 
This would bring zero ability for this type of menial ability at about 
the four year age, if the curve were earned through. 

If however, the. ('omplex Meiiliil Pn)ce«s curve leprcseiils the 
development of a cerloin ty[H‘ of menial heliavior, we should prefer 
to begin our theorotical curve, pf).s‘'ihly at ahoiit eighteen iiionllia, with 
the inception of language ability in (lie iiidiVKlual, even though wo 
may not bo able to meiusure it here 

Botwcon its inception, aii<l (he sixlli year, llie (!()i:iple'c Mental 
Process curve (4) m almost equally accelerated with the Fuiuliuncntnl 
Abillliy curve, though slightly below it. At the sixth year, the 
individual meets the educationally organized current of civilization, 
whlcli 18 designed to shape and fiisliion his mental lielitivior lie is 
subjected to educational, social and cultural pressures, repioscntcd 
by the school curriouluin, his coiUnets with teaclieis, and his con- 
temporaries in intollcotunl coinpcUlion. Hence at this point, a more 
rapid acceleration of his Complex Menial Proceas ability takes place, 
which overtakes his Fundamental Abililiv curve about the eleventh 
year. From this point to bm twenty-thnd year, our nssiimeil (ioinplcx 
Mental Process curve follows the trend imliciiled by our investigation. 

This may account somewhat for llio primounceil chiuige that fakes 
place in the individual's mental functioning jinst befoio lliii oiiHel of 
puberty. According to our interpretive mirve, at tins point, the 
individual’s behavior is determined less and less hy jnonoimced 
biological mental responee, and mote and more, liy an mtollectual or 
cultural response. This is in no sense a denial ihiit our solution of 
many problems, oven at upper ago levels, i ises no higher tlian bio- 
logical mentality, but It is to say that wc can and do develop potentiali- 
ties that make reaolion on a complex mental level, just as po.ssible, 
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and certainly more probiiblo. What wo epenk of ns ‘'control,” very 
often mcfliin to (Iclay a ''liioloRiral menial ” rrsponae, ft/jd refer the 
solution of the prohlem to llio In^^lier level of Complex Mental I’roc- 
C8SC8. It IK an oliKiTVivl plienoineiion, llmfc n pronounced change in 
incntnl bolmvior cliariietenzcH the period fiom nine to twelve years. 
Possibly the wane of hiologiccd iriental development and the con- 
tinued iiicreaw' of higiily eoinplex iiieiitfil processes may partially 
account for this change. Our interpretive ciirve.s offer an interesting 
field in winch to conduct further luvi'stigatiouH 

Our final coiiHideiutmii is the prediction of behavior. Frequent 
reference to our interpretive curves, will help to clarify the discusaion. 
These curves liave eHtiililished the noriiiul course of menial develop- 
ment. They predict that fifty per cent of the individuals of a given 
ago will lie found above and fifty per cent below them, in similar 
samples of the population. Tbm may be regarded aa a general 
diagnosis of mental behavior up to the Iweiily-llurd year. 

Prognosis is simply tim llieorelieivl projection of dingnosia, and 
our interpretive eurves, offer the most probable, diioclion for prognostic 
projection. For examjilo, since fifty per cent of the populntlons 
inveatigalcil, arc either above or below the curve at three years of ago 
and at twcnty-lluee aliki', it M’miis nuisoiiuble to nHsumu that the group 
which was above at Uiree years will also be, the group which ia still 
above at twouty-llirce, simply liecause the curve of normal mental 
development bos between theae two groups all the way. Any other 
assumption would deny the validity of the normal curve of mental 
growth. It is inatlieiualically impossible for a point one sigma below 
the curve at three years, to leach a point one sigma above the curve 
at twenty-three yents, without tracing a now curve in its progress, 
which would be entirely diffcrenl, than the curve which wc have found 
to represent normal lucnliil doveloinncnt 

Dingnosia eatablisiies the, iiidividuat's relation to normality and 
measures his dcvittlUms from the norinnl mental growth curve, on a 
straight iinc, piM'pendicular witli the cluonological base lino. Prog- 
nosis on the othi'r bund, concerns llio movement of Hus diagnostic 
deviation jmiiit, towanl (lie right, iii the (lirecUoii in which Lho ohrono- 
logical base line pxtendH, biU mil pajolfd to it. The Doviatioii point 
must move in a curve which ik of l.be, siunc general form as the norma! 
mental growth curve. This is but another way of saying, what is 
widely rccogmr.cd, that bright, normal and dull children develop 
mentally at a])proximalcly lho same rate. 
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It i« to !)(' notfd liimcNir tlin< \orj iloliiv li(rrf'jii.M>h willi iigo, hence 
posilivo (imi iir'gntixf lurr- « t*h«!tily witli arc This 

fad liplp*! to uullic*iiHi‘iiP‘ fiiij jiroKro-'tis i»ii lU'purnlo fiingtiosifl, 
hccftiiw* It gratloiilly Hi'jinraU’'^ 111'' •IhIhih’o !.>('( vM'<'n tin* iioriiiHl curve 
and dcvialf' curvi'H, with inrn-i-'iiiK yi'or**, iioikitiK llu'ir coinci- 
tlcnw nr crowitiR cvni moto rt-nintt* 

Tlin ahniM' of lh<' iMnolniiO’iilul Aloiiliv nir\i’, S<-t'(iotiH 2 and 3 , 
jfl an tvrdonl prolrm aumiint miy pmitiioMn of udnll Uidtavior, winch 
in baaod on nn infanry nirvo. 'Hit* lliortMiRli diuKfi<iHi« of the 
ono lo ftvo yvar 5)on«d of U«a (Mirvo, Kivoh no mdiPiitniik wUalcvcr of 
it« directum boUecn ten and fifli'oti or Ik’Iwpi’Ii cirIiUn'Ii and twenty- 
three ycatu. Kurtbormorc, tbr* riiltkind niid uitc-lh'dnnl development, 
represented by the f'ompit’x Menliil iToeiw eiirve, Sections 1 and 
4 , by wliich the mdivulunl will Im* more mnstuiKly evtkbiuled na iiBocisl 
unit, arc 80 incipient from om* to five yearn, that pro«no>0H \silli respect 
to this plinac of inenlul developnienl, in Ibis period, is very doubtful. 
In other words, the tloRree of accelerulinn willi which nientnl develop- 
ment takes place with mcreusiiiK attc, i r., the shapt' of the aonmil 
devclopmonl curves, can not bi« deiermitied )»y iiroKiiimis. Now 
that thcflc curves have lieen determined by mvesliKalmn, prognopis 
must follow the course they imlieute. 

Brolomarklc has bIiowii in hm '*.\teiilal (Irapli 'rypes" tluit the 
prcdidlou of human helutvior can only !«■ biiHed upnu accurate 
diagnosis of nn individual, with lespi'et to the two phases of mental 
development indicated liy our iiilerpretivi* curves. A supeiior bio- 
logical mental basis is not absolute nwurauee nf supermi ability with 
respeot to tlio development of ( toniplex Mental rrocesHes 

This IS only to say that social nnii-coiiformity wliieli reaches the 
acute stage of variability in cnnimal ads, is ju.st ns freiiueiilly the 
conoomUant of normal biological mentality us it is of abnormal 
Conversely the normal biological mental eiulowment is (piite capable 
of attaining high degrees of culture and bocml cnnforimly. Ihological 
mental development tells only part of the story, and piogiioHcs iiindo 
on this basis alone ate auhjcd to a very largo piobable eiior, largo 
enough even to invalidate tlio prognoses 

True prognosis must begin with accuiuti' rliagnosiH, with lespcct 
to Fundamental AbihUca and Complex Meiitn) I’roceases, and must 
Infer development in accordance with the curves, T'be fuiuiiunenlal 
endowment of the individual is basic, to be sine, but his ultimate value 
as a unit of society, is even more dctcrinincd by the permutations ond 
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contbinulioiiH of I’diuluint'iilu! i.c , the development of Ids 

Complex ftfentul Proceh'-ch 

The following eonrInHiniis mre iiuhruted' 

1. Alontrtl jhOiavior, «,h tin index of nii'nlal growlli iifc the f.'ollegc* 
Adult Level, Khould he mmiy/ed inlo Fuiulnmcnlul Ahihtics and 
Complex Menial Pnteessea 

2. 'I'lie developiiK'nt of Fiiiidameiilid Alnlity, regarded ns a bio- 
logical function, Imn not yel reached llie plateau sUigc helwcou eighteen 
and iwenly-lliree, years. 

3. (hiinplex !N[cnlul Pr<)ceH.‘‘e8 are more largely due to environ- 
mental prcfisiirrs lliun are Fundamental AbiJilie.s, hence they respond 
and increase more rapidly at the (’ollegc- Adult Level, 

4. Though ive may not e.xpect the Coriiplev Afeiital Processes to 
increase nidefuiilely, there is no evidence of an approaching plateau 
at age twcnly-diree 

5. Fuiuiamenlul AhdUie.M develoii as much, or more, in any single 
year between seven and fourteen, as they do during the entire five year 
period from eiglileen throiigli twenty-two, at the College- Adult Level, 

C. There is a posHibihly llml the ])rolinl)le proportionate increase 
of ('ojiiplox Mental ]T<)ees.s devidopment, and the proportionate 
decrease of FmuhuiU'iiUi! Ability development, just prior to or about 
the ago of puberty, may partially account for the ciianges in mental 
behavior observable at llim |ieriod. 

7. While uliildrmi uji to eh-veii years of age may lie more inevitably 
committed to reaolioiiH at tin* level of biological mental development, 
they become incieasmgly coitimilled to reactions at the higher complex 
inlellecliml Jevid lliereafti'r 

8. Predictions of belinvior shouhl lie based upon the shape of the 
mental growth and hehavior cut ves, which change conspicuously with 
increasing years 

I wisii to express iiiy gmtituile to Dr George Gailcy Chambers 
and Dr. II. M J/ufkiii, of Ihi' Deiiailment of Miithoinatics, of the 
University of Pennsylvama, for cnlicisiii and suggestions in the devel- 
opment of statistical jiroeeduies; to Dr Samuel W. Feinbeiger of the 
Department <if I’syeliology of the Univeisily of Pennsylvania for 
council and aN.sisliince in my investigation, to Dr, llohorl A, Biote- 
inarkle, uniler whose snpm vision tlie investigatioii was earned out, 
for materiiils and HUgge.stions which greatly facilitated the woik, 
and to llie inslnielorH ami stiuleiilH, whose cooperation ovci a period 
of till CO years made the mn tenuis iiviulablc 
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A MODIFK’A'l'ION OF 'PIIK (U)MrUTATI()N OF THE 
MUI/ni’UC ('OllUELATlON AND REGllESSION 
COEFFiriEN’l’S HY THK TOLLEY AND 
EZEKIEL METHOD 
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'iV/iHii'ri* CViluiiilijA I’liivoraity 

The Tolley «ii<l J‘>eki<'l tnHiuul of hftmlliiifa; the niultiplo corre- 
lation probletii mv(‘Ji m I heir piipor' iiivd further motlificd by Gar- 
lett’ etulefl tl«! roInliDii lielvweii the partial regro'^Hion cocfliciontS; 
b'e, in the form of a w't of linear iiornial cipialiuna that can be solved 
simuUnncouHly. 

These equations are (ovi'ii in two foriiiH: either in tciinsof the mean 
product or in the leriiis of llie correlation coefilcients defined 
by the relaliODH; 


7>iJ ' 


XCnra) 
iVoiefj ^ '* 

~~N 

llcwriliUK (inrreit'K equal lona (:t) (p. 42) we htive: 
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wlicre the values of Aji, .1^, Ahi, etc aie repiescnlod by ajtti, 
etc., respectively 


‘ TdlJej’i ft. It (Old f':/'i*lo<'l, iM it Jl ■ A Metliwl of Jln/idliiig Multiple Corre- 
liiliou PrulileiiiH Jminiol of iS/dleiOciiI 'IssocinlioK, Vol XVIII, Deo, 

1023 , |)]) «')3 - 1 ( 10 , 1 , 

’tfurretl, ttrmy K , A .Minldiciidun of Tolley and li/,oM'n Motliod of Ilniul- 
huH Multiple (lorrelutiun ProOleuia J'eiii’iKil of I''iluciilu)nal PHyclwhiyy, Vol. 
XIX, Jmi., 102S, pp ir, 111 
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Tlu'. columutt uf tmlU ji\ntH*ruitor un<l dolor- 

mmatar huvo ctmtinnu fmiurtc J*?, ,1.^, .In, o,tn Ik‘ (akou 

outmdc of tlio dolrrrninunr Mnn*MVi n lh»^ Uirinr^ of ilir iltlenni- 
imnk of Iho mimomiur apprur h** fuornrh nt tli** tl» f^Tiiimunf of the 
donominalor. TIimTuro* i)i»' vntoo nf .4 vnu Im- lownLioii aa: 
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In general the value of n can l)(‘ o\|)^‘^^<Ml in LIuh form, 

and noticing that in the detcrmuianl of the muiiorator wo leplaco with 
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tlio coliiam rii, rp, th, <“lc. I lie oolumn m which the coenicicnta of 
6u.n . « apiH'nr, luul tiiorcnvor that tmiiepoHuig the A^tJi column 
in the poMiioii of llie first column und the fc-th row in the position of 
the flint row of liolh ih'lorniinnnts we <lo now chutige the value of 
bik73 n imd (hen replace (lie i-th coiunui ui the numemtor in tho 
Biune manner ii« in case of ohlaming the expreamon of hjs jj <, tlio 
expression of hini „ m ns folloWK: 

f)i I rn . . , 

Ml ^ 23 i • ■ « Mn 


, (Tl Mn Mt, . 1 

t>llr 33 ii 

ff! 1 Tn r^K * * * Un 

M*' 1 ? 31 - < • Mn 

i 111 Ml 1 . * . Mrt 


7 An Mn 1 

Tl\{\ ovaliuilion of 0u's(‘ Iwo <lolorrninnnls, winch aic identical, 
With tho (‘XCOpiKMi of liuMr hrHt columiiH can be done a« follows: 
C’oiiHidor a dotcuninani 
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Multi plyin^^ earh lf‘ijn of i‘V(jry coliiinn by the first term of the 
column on the wiili iIh sign changed, and adding to it the prod- 

uct of th(j corresponding (mniH in tho flame low in the column on the- 
right witli tho /inst teim of tho original column, we have: 
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and thin \)y the pxpnnjtn.n n( lltt* il)‘l<’nninunt Uy imnnrft (tiiki)tR them 
along the ruw) is triirhfrtrim'il inUi: 
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Using ihia Irangfor inn lion, uiui noticing llml Un* icrniK (ukcii mil 
m tho fraalion on tho left ol tho dolmnumnl, {A) will ho I'liiinl for 
both dotcrininants of (2) tlic oxjircf-'noii for fin sj n can be 
rewritten oa follows: 
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ContinuiiiK llu' pr(tc(‘M nf (raii'ifoninnK llic* dctc'rinmanls iii Iho same 
maimor tlio ci)in|d('l(“ cvnluutioit t»f tiu' ftu sj. , ia concluded. 

The of llih iiirdhod of (>vuluiilum hen in the fact that in 

the ca«c of each imrlieiiliir roKirasirm cocflicieiit only ono column is 
inserU'd in a now pomtioii in llu- (Icli'iiniiinul, niul only ono row and 
column are traimixiacd in lli<* <h'l(<riinnuiits of the nuinorator and 
denominator Therefore, the evuluulton of any HubHcqiiont regression 
coolficipnla in xiiniilifieii, foi ua it in aeen from the iintuic of detorini- 
imnt (A) certain rewillH me relumed thiouglimit the cnliie process of 
computing, 

It cmi he readily sei'n tlml (lii« process of computing offers anothor 
advantage, namely tlml any regression coi'fncients of ordois leas than 
can be oh/amed during the computnlion of bu 23 

Lot us write down the M'l of (‘(pialions predicting &U.23 

ri2 ™ A2|/<i2,*i -h rijAaihij »it + 23 

iij ‘=- rjidiid'i! u h 23 

I Hr -■ J!ll''l 2 \hl 2 1 ) d* r2l/l3llln!t "h Ai| 6 i ;-23 

'riie I’c’ader ciui leaddy eoUHtriict llie vultio of bi^ss m the foiin of 
dotormirumla, it ih (following tlie puicess (iesciihed above and trans- 
posing rowH and eolmmis) 
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It may be observed tJiat when eolvmg the original equations for 
bj *23 n tbe values of 6u,s, butij, bmai, etc,, may bo computed. 

The formula for the coefficient of multiple correlation, R, as given 
by Garrett (p. 48, formula 7) w 


bun arm* + bun arm* |- 
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bla II * ♦ (« — 


substituting in this formula the values of hu « , , from formula (2) 
we have 

I2*i<sa...n) == hu.j4,..iirnAii + bi«.«.. nria/lii -h ■ < • -i- 

hln53 ..(n-l)>li»/lnl 

or in other form 


Tik 

ru 


. hn 

U2 

1 

r23 . . 

* 


rja 

1 4 . 

» ^\lri 

Tin 

_£2n_ 

^Gn • . 

.1 

1 

J’sjt 


^ Art 

riK 

1 

^23 . . 

. r2n 

Uh 

l23 

1 * , 

» ^ 3t» 


f’s-. 

^'3r. . . 

. 1 
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n-hich Again cualili-H lln* of all flic /f'a of orders {pfis than 

“n” ft8 well * 

Similarly, lln^ proeos allow u (In* t’alnilrUi.in of (i>o Hlnndurd errara 
of estimate of nil onicra ii|i lo and Inrlndna^ "h," iih given |,y dm 
formula 

ff’uj . 'TlV'l /f’lfjl J 

•Tim mw ftf»J Urn ml-min nlur*- r„ 

(Icictmiimuts, Tlio wiuif' fipjtliM nn'ijaniiiiii eii. 



the EEEECT of the 0^*2 normal cheye 
SYSTEM ON EAILHRKS AND OllADE \^VUJES 

J. I)K wriT lUVJS 

Vril\ dfHily nf 


Thoiti api)0ftr(*el rocoiitly a hluily* H‘(ting u\i iIh* fi 22 11 22-0 per 
cent procoduro for fi five |M)inl Rnultnn Hclifinc* It Iuih diaUucl 
theoretic adviniliiKe over (liow r<‘e(*nimeni!n! by otht-r.s, iiinonR them 
Doorhorn* nnd llviKK * Any tiw of the Tiormnl curve hk n Ijiums for 
grade difilrihution orouscs both Hirong (i|i[K>‘<ilioti parlirularly from 
those who do not know how l(» npply d, and caiually Hirimg Hupport 
from those who have given it the inOKl aludy and niosl nireful applica- 
tion. The growing employinenl of one or another niiHliltcadon of it 
prompts this analytical sluily. 

The purpose Iiere is not to almw how either (lie htnall m largo clans 
08 such is ftffeclod, The task afmutned is iwohdd, imniely: 

1. Aside fioin other faclora of lesl vtdidity, and reliahilily, and 
also aside from other chuhcs for leaving seliool, and a‘<ide fioin entrances 
other than as a freshman, whnt is the effeel of a htriel niiplientiouof llic 
0-22-44-22-0 system ns n basis for eidlege grades from (he Hiiuuipoint 
of college failure? 

2. And further, what w thiv compauitive value oi relative woithof 
grades from class to class when this system is aiijiiietl? 

For convenient thinking let us uimunie tliat after the weeding out of 
Freshman Week there romaiu ft group of one tliouwind sludenls for 
college work in ft course wliich conlmues eoii.seeuliv<'ly throughout 
the four college yenrs with three teiiim in each yeni. No otiiers 
join this purely hypolhcticiil group, none leave it e\c(>pl by grndiialioii 
aa seniors, or because of being fnileil by Die systi'in. llow many 
survive at the vaiioua levels? 

The adopted Bystem re(iiuro.s ft brief (‘xpliuiiilion. By niitiiic it 
forces caob new leiiu group into a norinal ili.stribulion. It automali- 


‘Eolls, Walter Crosby: An hnprovcnienl in llie Tlienretinil HiimIh of llm Vive 
Point Grading l3y8tom based on ibn Nnniiiil I'robslslilj (,’iirvi' Jimmal of 
Educaltonal Psychology, Vol, XXI, No. 2, Fpli,, 1030, pp. 130 

’Dearborn, W. F.: School and University (irniicH Vnnurhily »/ ICi'icon'iin 
BidJelw, No 308, Madison, Wmconsin, 1(110. 

*Rugg, Harold 0.: "Statistical Molhods AppliiMl to EdiiciUion " HoiikIiIoii 
Mifflin Co., Boston, 1017, pp 21C-210 
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cally fftjla hix JMt c'nti K'V'*h tsvcnly-ltto jmt c<‘nl a ftradt- of IV, 
forly-four i)cr cont a grade of HI, Iwenly-Iwo per oenl a guide of II 
and six jicr cent a grade of 1. Suiee (he group »k forced into iioriiialcy 
it may 6e fiHHUJiied ifial prnetiefiMv one liuridred per cent i« included 
ivithin :t3cr range. AI Uii'ii lii’gitiH iil. approxiinaUdy 1 6<r and lakes 
the balance up; AH lieguiH a(. a -i dkr ainl exU'nda up lo Urn former; 
AIII begins al a (kr and goea up to the loweal II; AIV begins at a 
-1.0(r and e\(efni« lo llie loiveM III; while lakea the Imlauce, 
-l.Off down. 

A table coiiHliiicled on (lie Iuimh of llna ayalein abowa clearly the 
elnmnalion that (akea pinre eaeli of the Iwelvo school lenns when there 
are three lerina {ler year for four yenra. 


■J'AiitB or I'aw.i'iikk I'EII Hcuoot, TariM 


'JVnu 

f 

1 KnUnriR 

Numlior 

fniliiiff* 

Accumulated 

fail Urea 

FrP'ilinmii \ 

i 



lHl ' 

in<)o 

00 

00 

2ii(l 

910 i 

60 

no 

3r(l 

Sophomore 

KSt ! 

62 

m 

M 

m2 

-10 

217 

2;iil 


40 

203 

Sni ... . . 

737 

44 

307 

Junior 




iHt . . , , 

093 

41 

348 

2iul 

0fi2 


387 

3rd 

023 

30 

423 

Senior 




iHl . 

077 

34 

467 

2na , 

643 

32 

480 

3rd 

611 

30 

filO 

Total gradiintefl 1 

m 

610 

610 


• Fraclioim aro iiiU'rpretcd iii favor of tlio BlmlcnU, eg 20}'$ =30 Bludcnlo, 


ABsumilig that the ineaHUrea employed aro perfectly valid and 
perfectly reliable, the poon'r lialf have all been eliminated. This may 
or may not bo ileairable, ii Platonic (|ueHlion might eivaily ajiao; if 
dcBirnblfi, why not ebininalo (hem at riiul and save, Ibo waHte in tunc 
and oxpenso both lo the Btudont and to tiio state? The nnawor 
might then corno back that the itieasures leally aren’t perfect, besides, 
It is held by some lo bo essential that a student try out for a special 
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ability in BOiiii’ rivyh linr's TIii'Kc an* <iiily iiii|ilirii(ionB urouBcd by the 
pinclicc ami Ihw'fori’ arc mily pun nliiclical to Hii> <|ui“ilion, 

U’lie tabic aljovr niiHWcra the lin<l ipicry, namely, a atnet application 
of the 0-22-4*1 22-0 plan Krailiially climimifcM by failing a total fifty, 
one per cent of the adnnlteil frcvhiiien, eixty at the hral term level an<l 
thirty al the ia«l term of ecinor ^ulrk. 





Aa to grades, what is their relative value from term to tciiii, when 
assigned in this manner? By tlie uae the geometric piogrcwiion 
formula^ the nomograph following wna constructed Since the upper 
end of tho diBlribution was not affected by failure the left or lower 
end was shortened. The border linos of llie giade Hiireads us given 
above were determined by the iiso of llolaingor’s 'rubles. “ Notice 

• b => or""' when t ><• Uio term WBiilod, n Uio number of liic term iii the Hcricfl, 
a tho first term of Iho Bories, niul r the ratio. 

’Hokmtsor, Karl J.i "Statistical 'I'nhlcs for Hlmlents in KdceiUion and Psy- 
ohology ” Tho University of Chicago Press, 1020. 



The (1 n 11 22 n A'or/wl Timr f^ijsU m OHO 

on the notnoRrnpIi llml Ihe uii-un nl ctieh level, Ijy confornung to llie 
normal dmlnlnilioii m cuiimmI l<i inigrale to the rifclit dunng the twelve 
terms a total (hsluiiof (if 1 fw on the original huw lino. It is from this 
now mean alwaya that tlin lixi'd (liMnliiilitin m nmilo each torni. /V brief 
study of the Rrn|ih nmkoH tin* roMilta ovidont 

A table of eoniimrod gruihw for llio four c1«kwh a.H pictured by tliis 
graph will bo hunirient. 


Fiiiht 'Ikum or Kack Ykak 
<* 01 II pan non of (!r«de Vntues 


PzcalimDn 

grtdea 

Sophomorfrt 

Jwiijoni ! 

oqnival'’hta ’ 

1 Senioru 

1 cqiuvftlcnU 

I 

All of l« 1 

UpjK^r llfl j 

1 

All ui la i 

Moftl of llrt 

1 1 
1 

All of 1 h 

All of llH 

A few Ilia 

J1 

Ijowrr ]I» J^iwrr of Ilfl | 

About (OH^liMf of 11 In 1 Ni'Jirly all of IHh j 

Bolanco of IJIb 

Over onc5-hftlf of IVa 

HI 

Ilnlaui*!' of IIIh 
M oHtoflVfi 

Bulruir*(i of HIh I 

' All of fV« 1 

1 <)vf*r of Vb | 

llalnnco of IVfl 

All of Va 

IV 

llainnro of IVh 

MobI of Yh 

1 Balance of Vh 


V 

of Vb 

j 



Similar Inblea of coiiiimrihon ran bo worked out by tho interested 
reader using llie grade of any other h'vel na a criterion. It is evident 
that the farther removed from eiicli olliei by bchooi Icrnis tho grades 
may be tlie less comparalile they become, 

('ONcmmioN 

1. A strict application of the 0-22-<l'l -22-6 noimal curve procedure 
as a bosiH for gradea in a twelve leim course would cUminatc prac- 
tically fifty-oiie per cent of llio matriculated group. 

2. Tills strict practice e,hiuigeH tho vnluca of grades from term 
to term so tliat a giado of I or II, etc. lias little directly comparable 
meaning unices asaociatcd with a particular term level 




MO fkf Jwiml <j Wirti'H'ii /'ji/fWifl 


Mudi him (iwn 'dnllcn sli^iii iiri'ilii’iinn ph (nim tliosnjiij 

111 lormft swrk, tliisuliiily Mitmln inilinii', lliituiili i|ii> iiii'Miiniii*uj 
iwinoil to liP iiorlfflly vulnl nml rdnliK llial prcilifluliihiy jojH 
ycl lie to due III llim lark nl rainpawliilily i'a|ii'fiiilly nt fflifjiuji 
i;nid(fi «[ Mint iiic iimlidnl Miy ftwii Ih'nliiiiiin ar MiplionioK 
plea, Wtrii iiiiiy ihn’ snalli't ''lalcia In prnviilf to apputeai 
ikrmmi al llie niiiii' liiiia In impl'iy I Ir InMr lediiiiipii' o! lliaaoiaiil 
curve auil ycl (ii kirp tlm i aliii' nf icuih ifial Imi ilmi i« iiao||||[ 
iliidy. Ollicni mil mil ilimiid-llril I'alli'pi' wliicli aiill liaa Ik lag 
scmcalcr year diviaiim and mil al •imv atari riiiii|iiiriNm mill Ik 
Mve Irriii edmolv, .llaiiy aiirli iinplniliuii iiti'n riillto to furllict 


conaidctaliou. 
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THE IIOUTTXK (’OMJ>irrATION OF I’ARTrAL AND 
U ULTII’LIC COllUKLATION 

HAYMONM I'TiAKZKN A.VO MAHEW DERllYHElHiy 
Aiiirn(‘An (’Inid Hi ivlUi AKMiumdoh, Now York CUy 

ProbftWy till' fiDipJi'Hi ji»i) jjiohl (Im'cL iiicDiod of corapiiUzig 
mviltiplc com'livlioH innl tiui fooflicionla of a mulliplc 

rogrcasioa (>(ni(ili()n i« llit* fortuiilioii of a ayHlcin of nonmil oquotions 
from the tnoiiieiilM mul itroiUiel monieulrt and Iho Bolution of these 
cqtialioott by (he Doolifde toe) hod a« reported hy Tolley and E/icktel 
ju Vol, XVIII of till' Jimnml of (lie Aminain Slalulical Association, 
A moilifwil form of llim inellind to lie Uhi'il when the lulorcoiTOlnlionB 
are known ami the raw moineiilH are not a^allal)l(l was published by 
Clarretl.* It often happens, however, (iuit not only are the rcKrcesion 
cocfllcienlK am) the mnltiple oojrelutton destied, but the partial 
coirelatioiiH are ni-edeil for inteiprei alive purpoM'B. In such problems 
it is mute advautageoiiH to eotii]>nl(' llie mulliple coiielation from the 
parliol coirclalioiiH aeeoi<inig to the usual foriiuila: 

Sun • ** \/l H r |)I>1 r’liMd • r’ll III (l~r'liiit nil 

and the n'gressum aiefiieients fioin the forum ia: 

hit 31 n “ 

rij ji ' Z 'naKl _ ~ m 

irj'v/fl — -- r*ij i)(l ~ f^u is) (1 ~ 13 ii-l) 

But the eompiilalioii of i>u « t mid the other higher oulor 
partials lieeoiiies iiieieiismglv laliorious im the nunilicr of secoiulary 
subHcripla aie ineiea'ied H can be shown tlial. the formula 

II -1- 2(ii ' 1) d- :»(« " ‘li) d- • • »(n “ « - 1) (1) 

* A ModilicuUon of 'I'lilloy tiad Uci'kii-rH Method of IlauilliaR MiiUiplo Corie- 
klion rroliliiiiiR Juiininl of Fdiiciifiiiraif I^ancliology, Jnuunry, 1028 
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nrJ 

Kivrstlif* iniiiiiiiDMt ii>un}HT»'f jt* in fcrroiniuiting 

n jKtrliul of till* i/<li or<!"i, nr, n» n’li* ! s'.oitl ■. ii >{h(ri tiu' iiiitiimum 
iiuiiilrtT of (iiiM (• ((In* foriiiul'i 

/ 17 *'t ''S I 

* * I ' . , I 

^ I » (A' I r „ 

iinihl 1 m' n|)p!i> )1 to iiitolly oltl iiii I'liTtvil of *}» Jidli ordtT. If will be 
iu)l*'(l llinl foiimil'i O) Kiw « ill.' mimiri’r of I'oinputafionB 

Till* powilili* iimiiln’r mi'i> I'o o^' niiniy iiiorc lhan lhal 

given liy fiirimiU VU I'or lo t ojopnle » fouitli »i tier partial 

il IK piiKKilili* lo contiMili' lliirl*. (ivo fi'in'o I'liflinlM iHforc finallv 
ohlniiimg II foiirlli onli r pnriril. Hii ll.o oilii r IimimI, only Iwcnly 
liiiiluilH nc'i'il 111 * r{ito|iuii<l if ilu* lll"'•l * conoiiiii lil <‘oiiiliinalion8 ol 
conclnlionK nre iinuii' iii ilio conijiiilriliim of iln* lowii oiiIit coefll- 
cirulK K\<‘n though the nmiimMiioicv 'irr oroh* ni Mjih ti way tlial 
tin* niiniiniiiM hiinilM r of iniiitol** ore i oio|iiit< li, ifn* iiMiiil niciliod still 
rftnKulcuvhle sitti ndoii u» luoid on uuoio«'t romlniiahoa ui 
one of till’ lower onlor iinriiul'* v.lin‘li wonlil lo'ilo* oil ilio Kiilisciiuenl 
work erroneouH 

The Jitelliod hen* pre'itiili’ii roinpU l"lv rhioHert'''- tin i-e ihn'iniltirs 
hy reducing (lie eohilion lo io»‘eli’iiiir!»l rtiuliio- li flioiiis the follow- 
ing advnnlft.ReKi 

1. The nlli order piiiluil eorrehition ik oIiIuuimI in the minimum 
number of opcralioiiH, «iiufe llie pio'-iliiliiy of ilii|dn'niion of etinipula- 
lioiiH iH e.hininaLed. 

2 (loriecl conibmiilionK of lowi r order jeii iioN me routinely mode 
ussuvuiR ihe ttccumle higlier oxh i pwrtiid 

3. All compnlulioiiH lire uiiloni'ilii'allv ^•lleeKeli willioiii a dniiblc 
compuliilion aa la often advised 

4 Uopealeil writing <if (ignieh is eliniiniited 

6 Uecauflc of the. direel iiieelinuieHl and Msleinolie ealeiiliilion all 
the cciinpulttUonB from lirwl tinier eoirelntionw (o the inviltiide vim lie 
done by n clerk. 

6. A compact, concihe reeoitl of the t’oin)nil:i(ions is ptovided for 
niiiig ao that all parlitiln of a given oitlei and deiioiiiiuiilion aie kept 
on tlio flame page, 

7. The imilLiple eonelixlinn la nbtinneil fioin llie partial fmmH wiUi 
a minimum amount of compuliilion. 

Tho explanation below may heein dillieillt and eonijilienled, but 
the routine is mmple and eiiHily fnllowed once llie ini'thoil m under- 



( 1 ) 

( 2 ) 

(3) 

(4) 
(fi) 
( 0 ) 
m 
(8) 
(fl) 

( 10 ) 

( 11 ) 

(12) 

( 13 ) 

(U) 

( 16 ) 

(10) 

(17) 

( 18 ) 

( 10 ) 

( 20 ) 

( 21 ) 

( 22 ) 

( 23 ) 

( 24 ) 





(y44 Tft<" «</ 

TIu- friiHfiuMSir.jril f*»rn» » jsli 0.** ** niid rJirrkfl in icrmj 

of sj'mlwtls js ttt In.iytitot I Hmi Uj' (•jwniMouH 
c(iiii|mt<' n j- t tif iuff ttpJtr j'i6rOnh from »}«• iii>"rr>'|}iU(»n('hii) of five 
vorifthlrm nn' iiHSirriV ti 1 II »lif iih IIkhI of itAim. 

fming flH'H' 1)1*'’ onltT jhHimUIo h wm.joI form fur llio vooipuimion 
of p/’Oruirl orttiT {»!iriinl‘ 

To make llii< iIioKriiiii'^ more tv,n(r<fe lie* imildiile rorrcliilion of 
four Irfmy mt‘n>-nr( iiieii«fi wi»h wctulif oml >w«t r* (rro'.'-imi roclTicKnts 
have Im'cu ctuiniuloil from fli" inlile of iiit<*ri'nrr(‘ltiliriii>< mvon below, 
nntl oucli slop in (lie roiiiini(Hli«ii i 'J he iin* of DiagramsI 
and II will) ()n> (♦xiihin!i(i*ni mil redime (he »- ( ming ritiiiplexity of ihc 
delftilwl <Uu:<’IionH Ihnl follow. 


Tablb I - -iMeiiroiihKi.vTieNe or A’>tm«oi ovintMO ‘Ci'MrH is d.sB Tiiomas'b 
V‘. l Tlir.S-TBMt-OM> ItllilM* 



I ttfigiii ' 

111 

‘ rin -ti hti ,vdth j C'Jh' 4 depth 

lloiglU 



/ 

1 


1 s.tiv 



Olicrtl/ ri(*f)lh 

1 wm 


avi.’i : 

Ihp widlh 

1 S71VJ 

r.Mj 

1 

VMt! t Dlito 


* Dftta gathered lu rooiit-eieiii wiili the Ndewd Ih alth Stmlj i nudiietod by Iho 
AiQOricnn OliiUl l[l•nltll Aivoit inlmii win te tUix ottiliite "ans mel iinrd, 


STKi'rt IN 'IHB I’OMl'ieurtllN' 

1 . To compulo lirat order jnirlmla (he r'a lire enlered on eiiecinlly 
ruled ehccls (wc Diagram III) ju^t an they would he entered man 
intcr-r table with Die except ion (hnl, four liiieH nre left hehnv encli r for 
the entry of computullonal (iguren 'I’lie ortli'r in u Inch llii' coeilicicnt'} 
are entered detetmineH the order tn which the vnrmldeH will he par- 
tmllcd out, and bofoio beginmiig compiUalioii (lii« ordei niiihl be 
decided upon so that the r'n will he so annnged on the nliei't us lo lake 
caro of this demand, The 1‘orielittioiiH of all othei (rmta with tlic 
variable to be partiulled out Ihal me eiileri'd as (he laH(, low of mter- 
conclations, the ctinelalimiH of all other traitH with the vaiiahle lo be 
partlahcd out flccond ia plni;ed hecimd fioin the hot loin, el e, TIiuh in 
this coinputnlioii we have, chosen lo partial out hip wtdlli fiotn all ibc 
remaining inter-; 's first and chest brcudih mh’OiiiI. (( bimpare 'J'ahle I 
and Diagram III noticing arrangement of vniialdes.) 
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Compulalwn of r,trlu>l nm/ MuH^pIr r„.r,Ulu,u 

T t. n4f.lv l.i‘l<kw I’lM'li «tf <1»'' <’‘trr4-l!iHoi»f‘ in lllic ln‘'l In"' *!•'? 

4 w \L rnrn lulK.tiH tt.ll. O..- vniinhlf In Uc 

of mtcrcorri lal ^ ^ j nK'H'ini nl ui.j«*ftnnK 




IIIM.IIKU III’ 


HciRlit 


ChMt Di'pll* 


CKcat BroiiiUli 


Hip WiiUli 
K 


Wi 

<11 

(3) 

(3) 

(4) 
(fi) 
( 0 ) 
(71 
(8J 

(9) 

( 10 ) 
( 11 ) 
(13) 
1(13)' 
(U) 
1(16) 
,(10) 
(17) 
1(18) 
(19) 
(30V 
( 21 ) 
(22)' 


I 

<'»k1>1 

iMyH 


wMn 

11 

lll-lftlll 

fijaH 



1 

KVM 

tUOK 

Ill 

(’iii'st iil'pdi 
OH'l.') 


4H37<il 

7331 

.070707 

'■'bor.o' ” 
718120’ 

IV 

Olu'Ht UrrjiOlli 
7428 

(1HOOH2 


' 2 

2 o 

) 

7428 

1 

2 aimo 

1 losr 

0845 " ^ ’ 


. « - w. 



, -A 






’ To Hiiniilifv till' oxpliiiinlion Jii wo .....n 

Tho uuXh .rVnot lu Ihn mchnary computal.onal 

■ri,« ccnmUadnim dcHcnbcl in Slopn 3, 4 and.". 1.4-l..iv an- um.. 1 
tho chock and aro not nocoHHUiy for the computation of In- ,.-u . u.la 
3 iioKinniuK at the oxl.H™ of the last row of minnn.o u- 
tions (lino 10) add each f.KUVO lowaida tho Ic t rccMduiK .Nu-h ..lumdn- 

t VO total three linos below (Imo 10). and in the colmn.. 

lo ilho ^:lt n.uio u^^^^ in the cumulative total. Thus, 7.r> ( is wnltcii 
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in Um’ V.rJ! \ ''•‘•Vt >■ wrjii*ii m >h< Hcrtud rolmin, 

{irtd I 1270 -i 7.1M1 1 ^ jn Un' ll.inl, jiii'l >-*» tin htwanlw Uielcfi 

unlll III) Ilf llti' <r'‘^ liM**’ 1“' n ill!' f in (ln‘ hi*-) cnluiiinio 

llu’ It'fl I) 1** II"’ II' II ' irii I" 111' I'l'l'’ ill!" 1 Ml i)i'' Miiinnninin 

'I 'Hu' liii" iJni'’ 21*1 ii‘ 'll*' iiSi' ■! fi‘'t<ii il»t' lun* Ilf /,‘k ilinc 17j 
iK'jnnniiift Mnnl‘»Tl% wiiU *1;' Ouiu* ! In *'.1" i"*' t ii', hi. ninl willing 
liniiri' in J'IH'i'* 'i' 1 "Ii w ilii ili" * '* * jiMmi "f i In* f in l In- IjihI column 
In lln* li'fl 

!i. Smn I'lK'li i'"liiniiin( iiiO r . "> nnnMinu Hi” l'»‘ ’ liiu* nf r'n fhnc 10) 
uml ri’cnril mi Inn* 21 1 "r «\«iiniS”. 2‘l*nt'i ilii* “imi iif 7128 + 

.K2(ll '1 

( Viiiiiniliilimi f>(i’|(‘*ii t" II 'in* illir'i.ii* *1 mi Mi:»nr.‘uii I\’. 

fi. If II p.'ilciiljiliiifj iii'ii'liiii'* 1 • ii*'*i |ni’ ill'*' lliil ii III I'liiiiinn land 
in lln* lioUmn row l STW in row Pu in iln* iii.Mrliiiii* lunl imilhiily by 
cncli Hiicpi’i’iliiiR nil ill!*’ 1 * 1 " I'll” |ir<*<liii**i’ .'ir<’ ’ttnlti'ii ln'iiculli racb 
of lln* iMTiMirilcr rV nicnliiitm 1 in hum'* “•.mi 'I'liUMiln* GtlOciUmil 
on line 2 |K K7r»‘2 x iliNs i iii* n *I mu Inn* 7 iiinii r (lii* iii’\l zrroi' 

in llio firal coliiiiiii ih (lit* iirmliir? nf ''7.'r2 >, Ml.'ili uinl (ill)') mi hm* 12 
ia .«762 X 7;V2H, 

7. Hiiiiilfirly piil llu* r in rMlniini II mol in llu* Imdiim rm (.7331 
in row 16) in ilu* lunclnm* timl tmiiiijilv li.s i‘!u*ti HiciM'iMluiji; r in tlm( 
row and roconl the imuliicl** in I'nUiiiin 11 in ^nl'l■t ' Himi mi liiii'H 7 ami 
12, The entry in cnlninii 111, Inn* 12, i** llu* inmliu'i nf llu* r m column 
III on ihe liiBl lini* ((liirifiy luiil llu* r in ixliiinii IV ( 7.12.i) Tlicsc 
CDnipululionH rivo tVio l•m’lrclt*^l l<*riii of tin* furninln lirloN' for I'lielmf 
Ihc Hix purliulH on PiURrain IV. 


8. Subtract cacli of llicw* jiriiiluc.ls obtuuiiMt in Sli'p 7 from Iher 
juBt abovn it in the coliiinn. TIiuh, ,1(1(11) iii liiu* .3 m 712, S - .0119 
(The opoialion.a nulicalcil arc, of cmir.*-**, iilunyf. [u-rfoi lin'd iilRobrai' 
cally, Riving proper regiirtl foruiRiii) 'I'liii m (In* iiiiiiiiTiiloi of Ik 
formula Riven above. 

To chock result Hiuh fur*. 

0. Multiply (111* r in (Ui> bnlloiii low nf ciiliiniii 1 (litu* 10) by Itio 
figuro in column II, line If), niu) I'liler Hie pimiui'i in ei'liiiiin I, line 22 
Thus, 18910 is the product nf S7fi2 X 2 KW.l l.ikewihi* multiply 
the r ill Uic last low of cninmn II liy (In* liRiiii* in eiibnnn 111, bm* 19, 
and locord the product in column II, hue 22; i e., (lu* I 0173 n Ik 



Compnliflum «/ /Vicijiif mui ^(nlf{^lh ('unrlalinn (H7 

product of Tin I X I 1~7M 'fin r«‘tumiiiu){ prcxhicl iii coiiium III, 
line 22, is found in u Minilnr manner 

10 Subliiiel llu' pindncls Mlt|:uiu*il nt llie]) 0 from lh(* Huniiiiiilions 
iilmvc iIh in on line 21, and enter (he dilTeieiiecs in Jim* 23 

U Sum Hie nuiiiei lOor-^ in I'oluinn I on luii'H II, S ami III obliuned in 
Slop H. 'Hie ‘•inn ‘'honid eijiial (lie (ipiuie .sliow'n in ('olninn J, line 23, ii« 
the lOHull of Sliji 10, (If 100'» 1 '21111 1 ,1023- fiOfjl)).’* Of 
courRO in Rorne <h‘‘<'R llieie may lie a ditfereiiee of 1 or 2 pointa m tlm 
last deeinml pliiee due to droppin;' of deennalH In a winiliir iniinner 
coluinnH II iukI III me elieekerl, 

'J'o compute llie deiionniialors; 

12 Porfoiiti (lie innltijilieadons <h senlied in Step (i uaiun tlm i ow of 
Vs, line 17, inMeiid of line U», and enter (lie producln on llie linos 
below the seveiu! numerators oldmned in Step 8 This Kivea (ho 
(lononnmitor of (lie formula above, (f r 32S!) -- 183701 X .079797) 

'fo check iheM* eidneh: 

13 Miilliply llie A in eohiiiui 1 by llie siiiiniialinn in column II on 
line 20 Keeord in ('011111111 I, line 21 Snin the denoiinimlors in 
column I nbliiuied turn Slep 12, lines I, 9 and M The two jesiiUs 
should cheek. Snndarly ninlliply tlie A in column II by the Humiliation 
in cohinin III and (he prn(liie( should eipinl (he MUti of the products of 
k'a in coUimii 1 1 

Fund conipu(tiliori>^' 

W. Divide llie nunieralors olitumed in Step 8 by the respective 
denominators obtnined in Step 12, The lesults are usually written 
in red (italics here) or ollierwise made distinctivo ho they can bo 
picked out readily. Tins (luotieiit is the partial. Foi oxamplc, 
.1009 -t- 3289 piives IIlKiS, whieli is the pin liiil conelivtion of heiRlil 
and wei(;lit independent of (he iiifUienee of width of hips Similarly 
.3579 va the lelalum of e,heat bieudlh to cheat depth independent of 
Inp Width 'file only cheek on this division is the multiiilicalion of 
the denoimiiiitor by the <|nol)enl, (dilainniK tlie nnmeialor, 

'I'o compute second oulei partials. 

15. 'Die fijs) Older pailtids idilained on Diafirtnn TV aie entoied ns 
.shown ill Diiinitiin V. 'i'lie ainiuuement is (he same ns Dia{fiam III 
except Hint no eiiliies nie made on line 10, since u)l the eon elutions 

* 'J'liJs jnav 1 h‘ hJmmvm Io l>f* Irur hv Mu' npmlion 

{fn - rii,r^i) I (^n, - riirn) h (rn - ritru) ^ 

-) "I" » U(r 26 -\- f'ib 



m 


The JnurmI nf 


witli hip width linvi* lHM*n pjirliulhd nuJ Tin* liiir* m now clicsl 
Iwadth. Tlwf*' rit<^ i’h'‘ck« d hv PuniiHtitimiH of tho micwpswc 

ColuinitH of DiiiRrfllii IV HKtcMiiK Htdi (lu- Hiniiiifihoim r»f Uk* com- 
HpondiriK poliimn of ihoRrain V. 15> )H'rforiinin' flio roinpulalions 
dpwnlunl in KP'jw 2 to 1 1, tlo* vnri'ddo ch* ‘ t lw( toUli v\iU he parimUcj 
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‘Diftgrftin IV islikfl DinKnoii III with (In' O'kiiiiiiiiik t umimlntioiiHiMiiniilr'O’d 


out. Tho rofinUa obliilnod from Ilicw' coriipulalioiiH iin* all iclnlum- 
nhipaot two of tho vamhlon irri'Hpodivo of liip width nml <'hi‘hl hicuiltli 
Each of Uvo bucocbbivo highi'r ordi'r partinlH cnu hi* i)h(iuiu'il hy 
repenting the proccBs, purlinllmg out one luiihliimiil viumlilo with 
each icpoliliou. 
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Computhhnii f«f , M nini fiu4 Unr^i r<rfh r p'*rhiils nro pictured 
111 ])i!iKn!iiii \ 'Ih»* nfil'T Hhjjjinnl ni ili(‘ iisunl 

iiiunri^^r ’I In* fl*inl unhr pirh*! i'^ in iliis flinj^rniti 

iiwtl ^wll li*' uhm] I'iti r m }h*' r iMmjj i,f i]ii^ n i^n m ihh (’of'flicicnts 

It in oht^4irii t[ frnru i\ r» ur 4iiv< m ^ m r»r<l« r r<irri*lationB 

TImk IK jM* iif lilt* orfli‘r n-2 

(wlirn* n iK llu^ iiiinilH I »»f , for 

y*li;j4'i ^*^3^411 fck) 

^l 5 !i 4 w 


^l\ tl 


^ 4 - 4 > ^ 

f 1 ? li, ^ < I 3 iJi 

4 / T J 4 1 , Tf ^ : 5 4 >t M j 


unci 


.1 


Tu (’ciiiipuSi* thv lunlhplr n»rrc htnoi 

'J*lii* mullipic* CHrrc hiUnii rin llnM* n» m cl as a funclioa 

of Iho iilic'nufKin rMallirn nN of fla* pariri! c'lcrn I'lfnni, ulius: 

/il ^]J4 PI \^1 « -i) 

If llic criN'rion vuniililc* Iimk In \ u u •! iii c*i*liiJiiii I ni tin* rnmputa- 
lion of Ihn Im^Im r nnl* r pM^hJl^ all of tin* / V n'C|inn‘fl in the 

abovo forjiinla have* hau ili^u riinin *1 . I Wul 

u « i baK brnri roiiipipni) np I lj<* I'cirm^-pninhiiK nun bn (pnckly 
(iGtormiiind from MuH’r'H ^rfibli** In <lic* illuKtrahsn fublc* tlin /; of 
,2iS0fi IH 0571*18 liy w ruulfiphvutinn tif tlm I/n in llu* liii-l rnlnnmon 
each HUcaCKsivn uliant, anil ibn K of lln* oninr p,orfiul in cnlumn 

I the nuiUipIn A: <»r „) will In* obl’inuMl A.i sju = 

483701 (Diagnuu I\\ linn 17^ X SlIlHl? {hiagrain V, lino 12) 
X .850175 (l)iuRmm V, liiin 7) X 057ns (/ nf VisOO) - .3102. 
From this product 1{] Nsdunli, nf n« \/l “Am olilaiiicd 

from Mmor^R Tubb^n. In llns n\iun|iln •ant* 0177 
To compute the rogrnsMinn ronlliiunnl 
If wc Rubfllitutn in tbn imiUi|»ln rngrn^'Mnn ncpmtinii 

= 6 |» 846^1 + 5 13 3 |'»A 3 d' h\n -jaliA I I’ /nil 514 V t W 

tor 5n au) 6 i 3 nnf ntc. tlin purliiil r'.s and llic‘ [Kiiliul ct’h tbat urn Ihoir 
equivaleula tiu* ccjualion rndnrnK In 
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(!omi>u(ahtifi of Pmlml mid MulUjdc Comlalton Cfll 

If, in li'rinsof Ihi' inii‘’(i!i,(iv(- jmililciii, wo l(«L A', = woiglit, A'l = 
hcifilit, A'i ~ clii'sl (lr|»lii, A 1 - otir‘'l liromltii iiiul A'j = hip wulLh, 
then It win roiiflily lir- ‘fcm thul (ill Ihr* » 'h iuk) piirlml k’n in the 

firafi two IninH of i'(ji)jihi)n fH) arc (iikcJi wiro of by i 1 m> compiilntionfl 
on Diui?iniii IV uiid DiMirram V hrniii Ihiigriiin IV W'i> f;(>l ha, ka, 
Ij5, 1111(1 finiii Ihnnimn V we i»et A,, A,., //ji r,, nu. «iul rn 246 

In (mlei' In cniniiuie I lie inirliuN ll(•('eh^^ry fni llio |,wo icrnuininR 
terms it H ^^^■(•l’^«llly tn nmke the ‘■.iine nunihci of eoinplitationa as 
lliOH’ n(ii<l(‘ (11 l)i«R(<iiim IV (1)1(1 V, reveri-i/iR (he oi<|(*i m wliich the 
variiililen arc puitialh'ii oip , in teiiiiHof the ilhiKimlivi' proMern, partial 
out the viuialiles ilk (he onlei In irIi), clnst depth and chest hieadth m 
addiUou In the order Inp width, eluM hieiidlh mid chest depth ns 
illustrated on the diniiiiiiiiH pre'-eiiled iSucIi coni]mtnti()nvS would 
yield the piirluils nsiKiied for (he reniuiiiinR (wo (eririsof ('(juation ( 13 ). 

In prohlenm involviiij; more ihiiti 5 vnniibh'S it is only necossaiy 
to RO from ri“ro oider r’s to the (n -- 2 ) order purluils one time in 
ord('r to olitnin the Multiple it. If the reRieHsioii ('(lualum la dosirocl 
it 18 nece‘'‘'ary to eoinjiuie four (« -- 2 ) order piirliuls m the manner 
indicated n 1 10 ve nrnl (hen retnrn ((ttlie second orden's, leanangc them 
on (he work slieet am) (lien eompiit(> o(ln‘r jairtials of oi'der {» — 2). 
For example, if the piohlcm iriiolves 7 variahles, luul in the first 
compulalioii (he variidiles are piulialled out in the older 7 , 6, 5 , 'I, 3 , 
givinR the two parlialH ? u .umit and 1 14 34147, and if in the second com- 
putation till' vaimhles aie part lulled out in (lie order 2, 3 , d, 6 , 6, giving 
the pnrtials r,; um and ria ntn, the ri'iiimiiing tivo parlinle desired 
could he olilmiK'd hy pailiulling out m the order 2, fi, 7 , 0 , 4 , giving 
rH.ijM? and r,6 But the ('onipiilaliona necessary to partialhng 
2 and 3 nut weie doin' iii (he second (ioiiipiilivlioii, so a renrrmigcmcnt 
of die seipienci' on tin* computidioiial form of the second order r’s 
IS all that 1.4 neecMsary for tlu'se adddion.al higlier order r’s This 
again rediiceH (he nniouni of eompuiiilion nece.ssaiy. 

Tlunigh the esphiinilion iiiiiy seem long and complex, the routine 
18 very simple. After it is umlei stood and has become mechanical 
m opi'ralion, the (iiu(> eaviiig m ii))pu)\iina(('ly one-haif of the usual 
method. It can he esplnmed (o eleiks veibally iiuieli more easily 
than liiiH been [jossildc m thin wiiden exphumi ion 



k STUDY 01? QUKSTIONNAIRl? TECTINIQUD 

VRANK K. HIIUTTI.EWORTU 
Yalp Utiivoraily 

This study shows that imdor the coiuldioriR <lcfinfid bolow Iho 
enclosure of a twenty-live cent piece in a inml ciuentionnuirp hrouRhfc 
32.4 per cent moio leplics than the same rjiicHlioniiiure without tlio 
coin. Six huudied eight persons receiving the com loturned Til.C par 
cent replies while throe hundred scvcnly-six not locciving the coin 
returned only 19.1 per cent Data arc also presented on the rdlc of 
selective fnolois and on relative costs, 

Tho study is a hy-product of an evaluation of the Cattaraugus 
County Healtli Domoiistiation in wcssleiii Now York. Foi n pciiod of 
seven years the Milbank Memorial Fund linanced iiu intensive 
domoualration of rural public hciiUli work in Cattaraugus County. 
In. tho spring of 1930 a staff of expcila under the ducotion of Professor 
C-B. A. Winslow* undertook to evaluate that work. The author 
assisted in a survey of tho educational uapccLs of the demonstration 
among school children and adults. With fiome roluctanco a question- 
noiro by mail was used to assay the atlitudca of adults cspocially 
toward the financial support of public health work. One of our chief 
doubts about the questionnaire was tlie fear of an iimdequalc propor- 
tion of replies. To solve tin, 9 difliculty, it was docided to enclose a 
twenty-five cent piece secured in a com mailing cai d with each ques- 
tionnaire. Evaluation of tlie results required a control county and for 
this purpose, Steuben, the county just cast but one from Cattaraugus, 
was selected. The inquiry to tliosc counties consisted of a short 
personal letter each of whicli was separately typed one! obviously so, 
the questionnaire proper containing six qucstioiia, a stamped and 
addressed envelope, and the com. 

The investment involved and the novelty of the procedure naturally 
led to an attempt to test tho effect of the com. Accordingly, tho 
inquiry was duplicated in all respects save only two sonLcncos In the 
personal letter and tho presence of tho coin. Tills inquiry was sent to 
poisons in the six Now York coimtics immediately surrounding 
Cattaraugus and Steuben. 

Tho personal letter which accompanied the com was as follows: 


* Winslow, C-E A., “ Health on tho Farm and in tho Village” Macmillan, 1031. 
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A rcspoiiHihlo orftaniRfilinii Imw rifskrtl ni<'' mi an imparhal oviUicler lo make a 
gyrvcy o( opiruan (oward piiMn^ h(rtlt)i uorJv m tla* v,c.Htvri\ coiifitjVjj of 
Yo^k suit*. Tiiiy aro huwmn lo Imvo 1(H) por roiil roplH>^i to thn <iuofitionB find 
ftCcouhiiKly Imvr in<>vi«l4‘r( finid'i \Wurh inaki» poh^thlf' llir* rndosod cam It is 
not m pnymoiit for vonr tnmMo in miM^MnnK iho (piralionH but rather a Hinull 
loken of ftppn'eiuiimi of \mir rofipiTaUnn. 

Tho lollrr not oi’minpanioil by u roin aulhsi jttitod tlio following for 
tlic IftHt two HontencoH tn I hr* uImivi* Irltor: 

Tho roHiillH of Hueli u hiin ey u d! lie 1 rii^iorl (o ilir‘ ovlout lluit every emo eonpou 
fltc8 m nuHwerui^ tfii* enetoJifil i[iU’4fiMnH I will he grateful if you will indicato 
your Qpiiuon at{<} w^nd it for {(oiu* yrotnplly m iho {^aeloaed itlmnitcd and 
addrcwoil env elo|ie 

Those lcLlcr« woro wnlli-n on tho slalionery of the Dcpailment of 
Kducalion of Yalo UmvmHily. 

Tho coni])ai’al)ihly of I ho Iavo aroriw lo wluoh Uicro inquiries were 
sent is of iinporlaiioo in ovalualing tho inOurmcft of tho com. In con- 
nection with tho hr*al(h Hludy, wlurli was HOiirclung foi differences 
between ('ultarau^us ainl Slcnhim, all uvailuhlo popuhUion, economic, 
and cducafional Hlalialies woio oxiLinined On tiurty-aovon basic 
factors lliolwo oonntioH jirovrsl (o l»r‘ very niuehaliko, Oattaraugus is^ 
of courso, very rhlTcnMit fiorn SU'uhrm in om* ichik^cL having had a well 
orp;aiiizc(l and mhuiuairdy Imanced county health piORram foi seven 
years wlnle Slerilir*n had )uul rui organr/erl county henltli program. 
However, the n^jiheH to tlu* quest lonnairo showed only slender advan- 
tages on ()if* pail of l)i(' ( 'nllainiigiiH respondeiilH For the purposo 
of this study we feel junhliiMl m eomlnning llicin into one area which 
will bo re/eried lo as ilie eom luea, Addihoiml data Icsling thn 
coinpurabihty of the coin aieu aii<l I he non-com luea was not examined 
for the ronton tluit only (lu^ poilioim of the hi\ counties most inimcdi- 
ntoly adjacent to CatlnjaugUH and SfiMiben worn canvn%od. Instead^ 
reliance is placed on I he hiindaiily h(itw’ccn (hiLlaiaugus and Steuben 
which aie sepamled by tin* inlu'rveiiing county of Allegheny The 
complete details me leenided in ( h(‘ aeeoinpanying table m the oidei in 
Wiiicli llu'y me diMcussiut in the leM, Data for the coin aica are also 
given sepaiafely for f ’atiaiangUH and Sieuljfui coimfi(‘H 

The iiupniy itself [iKivuled otluu eonliols. 'Phe queHlioiinaiieH 
Were sent only to na)iu*s listed iii village tel(‘phone direelones, CIiur 
inlrodueing an ccoiiomie, eontiol, and aiiproMuuitions lo social and 
cultural contiolH, In ilie noiHCoin aica bixtecii village exchanges 
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BcrvinB forly-lwo hIiH Ktnallor liaiiilctH and cin^vKHidH woro enmplcd 
hi the com ftiea llnrly villano oxcliHiinoti HTvitiK lifty-w'vc'u luldilional 
hflinlcts won' Kiuiiplod Tha mxIoi'ii MllujiCH in the non-com area 
avoroRO 8 0 mllcH from llic Imrdi'rH itf lh«* coin area. AU of llie ques- 
lionniurca were mailed n« tin* a.imc day 

Qucstioiinuin'H vvcioinailfil toevery cirIiIIi iiaiiic on (lichc exchanges 
exccpliiiR llu' nuiiicH of InmieHa limm and of women Tina gave 
three liuudred eiglily leltem to (he luui-coiii iitul m\ hundred Bcveiilccn 
to llie com iiiea Four and nme leiiera were relinned for inaufliiciont 
addreaH. Of the Iliiee luindred w>ven(y-^ix and mx humlred eight 
pemontt vvho piesumuhly received the u«iuiiy, reveiily-two or 19.1 jrer 
cent from llie non-coin area and (liree hiiiidri‘d foiiileen or .'ll (i percent 
from llio coin urea made Home ri'ply 'Hie diffeieiiee of 82 1 jmr cent is 
sixteen Uines an large as its jnohnhle enor 

The coin area roliirned 2,7 (iiik-.h aa many ie|ihe.s 'Plim ratio grad- 
ually increased (liroughoul (he period ilurmg whieli re|ilies weic coining 
in. Tho first llneo days xvith a total of one hmidied lifty-thieniephcA 
showed a ralio of 2.r>, the .seeomi three daye witli one Inmdied fifteen 
replies showed a ratio of 2 (>, wliile the wm'oikI, thud, and fourth to tenth 
xveoks sliowcd ratios of 2 7, Ihf>, uinl 1 U ' 

A detailed tinulysm of the respoimes is pieHoited Hinee it Ihtows light 
on two probieriis of the (pie’ll loiiiiaire method Oiii’ of the Inuinlmg 
ghosts of this pincedure is the Melectioii which presuimildy is involved in 
the fact that some persons rejily and otheis do not. Piesumably less 
selection is involved m !>'2 per cent lephes (htui in 10 per cent On 
the other hand there is the (inej-tum xvli(>lh(*r the pieiience of the coin 
tended to distuib (he aimwma The data olTm’ iimiiy lesl.s of tlaxse 
questions ulUioiigh in the iiiilure of the caMi it i.s impossible to siiy 
xvhetheT one or both factois are responsible for any diff(*ienees Inter- 
jirctation of siniilarilies is equally dillnMiU mnei' they may mean that 
neither selection nor tho coin disturbed the answei.s oi liial llmsc two 
factors tended to cancel eacli olhi’r 

A preliminary point of .some iiiteiest is that fomteeii of llie three 
hundred fourteen respondenltt fioiii llu' com aum leluined the com 
Seven of these iillcd out t)iO(|U('8lioiinniie in detail and by coninientsor 
implication indicated IhtiL they llioiiglit the (loiii imueees,saiy while 

' Subsequent to tlio pminirnlion of tlan nrlicin (eii weeks ufln miiiiIiok the 
quealioannucs an additional ton reida’s wore reeoiveil U|i to llu* I'lid of tin* fonrlh 
montli, Nmo of tUoso were from Itw com nteiv and oiu* fioin l\io noii-vom auiii. 
These additional eases arc not included in tins nniilyKiH 
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seven retuineil lln* t’tnli widmui llu’ <pM'uiiiiiiiiuirf‘ or witli tlir (iiicsUoit' 
nairc left i'lnnk. Alt hour'll tlic nui'itioiiiuu'rc ‘•mil ^|)r^'llic■nl[y "You 
do not need to your iirtOK'" (vw-lvo of flu* fouit('(>ri fir K(} jior cent 

gave llieir iuuih'i uliile (Hoonr; ilie ofli»T thu'/* liiKohed ref'fKntdentB 

only fifly-hvo or 17 per niii j,'i*ve ilnir Jwniih 

Tlic Mxth i|Uik(ioii 10 till’ ni<jiiir\ n^K^‘d whellier tin* ro‘'pond(‘iit'8 
taxes on real i ‘-liiie umniiiiti'il in ov« r 'JllHI the |tic\ iouh year. In iho 
non-com area, of eiMj-tiylil aio-xii not;; lliii iiuimIioii, (iH.2 per eeut 
reported linin' llinii '’ItHI liisi'i In (he (’nm urea of two Inmdred 
oiglily-live iiiihtterinr* Hiik i|tietittoii .V| .'i (ter eeiit iiiudo lliH repoit, 
The differeiiei' IS ;{ 7 < I tl per eeiii. All of (he duiii wern tubulated 
separately for thore reporting looie and for iIioh* repoHifiR less tliuii 
SlOO (av'H but, ‘'inee no dilfrrener'. in f):e aoMim of the two ^roiijw 
appeared lliey are eonilioied in I lie di'>eu.''‘>in» wbieh folloivs 

The hr.sl (lueaiiou in the tii<|uiiy u^Kei! Ihe re.sjiondenla to rank four 
funcUmm of piiblie, health work in oiilerof iiiiporlaiice. FoiTy-PiRlit 
from (lie iioii-eoin are'i and one hundied lifly-eii'lil fioiii the coin aieii 
properly followed iie<lineiion8 in ranUiii)' Ihe foiii fiinctionH. The 
perceiduRes of eoiieel r.inkinns for fiinetiou (n) were ‘17.0 luui H.O per 
cent, for fiiiietion (ti) M .( and 77 0 per eent, foi function (r) 27.1 and 
30.7 per mil, for fnnelioii (//) ."il 2 and .'il 0 pi'r cent The Inif^est 
tlifferenee heie w 0 li ' A.'i jier I'ent 

The H'coinl, lliird, fouilli, and liflh (|ue,s(niiiH coin'eriicd /iniiiicml 
supjiarl, of pul the heullli work l''avoiable a(li(iid<*s were expressed 
by anawerniK ‘‘No" lo the seeoinl (|iieslioii and "YeH" to the third, 
fourth, and liflh Koi llie nou-eoiii and eoin uiea.s (lie pereonliiges of 
fnvoriible replie.s weie "h 1 and 77 I pel cent, 711 o and 70 1 per eent, 
41.9 and th) A iiei eent, and 7.’ H and 77 2 per eent, Ifeio the larResl 
dilTcience is only .4 I pei eent. 

We Inin next (o (he eaie with whteli fin* inqiiiiy ivti.s tinswcicd by 
the two aieas as indiealed by I be piopoition of omitted or iinccrtiiin 
answeiH lns(ea<l of sevenly-t wo and ihiee liuiulied fourteen cases us 
oui base wi' shall use ,sevi'ii(v-one and (luce hundied seven since, ono 
vespondeiil, fioin the iion-eoiii aiea wrote (lull, he had mislaid his 
quest lomuiire and seven fioin the com aieii iclnrned the com without 
answeunp; uiiy (|Uch(ioih l'’or the six (piestioiis (he iiim-com urea 
iiveniKeH l.'i 0 ))(«r cisii. <mnsMonH oi unccitum answcis wlide the com 
aicft aveiaKCK 17 0 pei cent Allah sis hy siK'cdic (pte.slionH, lioivovor, 
reveals one sif’ni/ieani differen<‘e. ( Inly 32 !) jier eeni fjoin the non-com 
area failed lo lank tlu' four fiincljojis of public lieiilth as instructed in 
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corapariaon with 50 4 i«*r rnit fniin I lu* cniii im‘ri. Tlio lUnprcnce of 
17.5 r>cr cont iff 4.1 liifu'ff IfftKi* iin i<a pmimbic <Tror. t)n two other 
qupBlions ihf* coin area MkhmmI mure wliih' nn f ho other three 

ft filiowod fewer oiiiiKHionff. TIu* lnrj{cM of tli(>-»(> ilifTi'roriccH Is only 
6,2 i>cr cent 

T)ip re«pond(*rit,ff from (ho two an-iH wen* iTpiolly rondy to back 
(heir rrpliPff with (Imir a, Alllmu^h the (|U('Htionnairc 

fipeciricnily aaid, ‘‘You do Hot npi-d »o Mtrii yrmr nnme," 15 5 per cent 
froiiA the no«*r««\ area nittni’d tluMf iiium‘«. After dtrlucling the 
fourteen cukob who returned (hii eoiu and natunilly wanted to receive 
credit for it tlicro remain 1^.0 iMr cent of the leHimadiritii from the 
coin firoft wlio gave their ntiiiieff 

A final li'Ht of tl«‘ influence of eeleelimi imd of llie com is the mtemt 
indlcftlcd by comment.s. Tlief«‘ were invited by '* 1 w l hi> reverse side 
for commotUff" following the*, hifftli (piimtion Kroin lli<> imn-coin area 
44/) per cent made cummetilH wliile from (he coin area only H3.2 per 
cent made any comments*. The diffeiem-e of U.lt jser rent la only 2.0 
times a« large nft its prolmide error. Wliile a Miialler iiroporlion of 
rcBpondeiilff from the com area made eommeniff, (Iiom' who did so 
made more and longer coniineiilH. ('oiiiitiiig eiieli (pialilication to a 
spccilic question and eaeli piirtigraidi of diaeu'iHioii as n eominent, the 
nou-coiu area avcrnRca l.7fi cornmentH fH'r isereoii conitnenling and 
.79 commontfl per person replying. In the emu area tliene liguresnro 
1.92 nnd .01. Cuiinliiig nil wordi in (be eoiniueiils givea an averngo 
of 30.40 per person comniendng luid of IH.oO per pinion leplying in the 
non-coin area in coinpariaim with 4S.tl2 and 1(1.2.'') iii llu* com area. 
The most signiticant of (boM* differeiiees m only 2.2 timcM aa large ns its 
probable error. The differenceH ure aho exaggeiated becaiihe those 
measures arc the ones in which (‘altaraugiis iipproa<>hi‘s sigiiificaiil 
superiority over Steuben. 

The relative costs of llio two proei'diires aio of (lOme mtmesL. No 
exponso was spared to give the inquiry a fiivomlile uppearanen The 
letters to the noii-coiii area cost 10.4 cenls eacli while lliosi' to the coin 
aiea cost 36.5 cenls. The initial cspeime to the mm aiea was 200 
per cent gicalcr per letter. Tim huger (iiopoihou of leiilms leduced 
this discrepancy very much. In (losts p(‘r ii'idy of any Kind, the eom 
area exceeded tho non-com area by only .31 iier cent In cosl.ff [icr 
relatively complete reply the cxceas for the coin luea waa only 32 per 
cent. In coats per reply contaimiiK one or rnoie coimnenls the cxccfii 
was 80 per cent. In costa per coinmenl llio CM'CSff was (U per cent 
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IVtiulod HmilyniH tif lli(‘ rchwl hIiowh noghgible 

(lilTorciii'O Ih'Ucimi (Iu* nmi-i’tnii luul ('(tin nn'iit < )ii (me riiic.slion (1 ,q 
rrfip(md(’n(H (win (he wm im-n ‘•IiovmmI unnficiindy \mo <»iiiMtioii8oj 
(luccrliiiii iiiiswiTi*, liiit ('fiiiMiIt'nin; (iiiii“'|()iih aiiil uiintlniii answers 
(o ail ([iicutKina llic iiitvaiil'iKt* itf llic iittii-rtiiii ana r* idily ‘2 jinr ceiil 
A liifKCi' |mi|i(iMioii nf ri'winiinlciih frttiii ili" iuuhmuh liicn 11 ^^. 
cniiiitinnh, bill tin' (’iiiniiif’iiiH (if u lunnlciifs fmiii ilic rnm aiw 
IcikIimI Io lie longer. 

From llif nlwdifc nf liiffcri'iio h hi ilic K^iitiiitiM (if llin iiojhoiii 
I o tlic (|IU'hI ioiiiiiii]i\ iiim of llii' btlliiw ink iiif(‘i(i|ir('s ih Uiniiintcd, 
NciIIkt tho M‘li‘i'fi(in invitlvcil in a Mii'ill piopnrlKiii of rcplii'^t nor llie 
priwnce of (In' ('oiii was (li‘(lurbiiin (o llic i(‘i>!ii‘4 The infhicnceol 
BPlcctioii mnl of llic ('Oin niiici'lloi) I'adi o(li(-r 

While llio iiniial 00 , si of (MicIiniiu a (tti-iiij-livo ('('iil, picnc tiiiulc tlic 
IcUons 1(1 llni com iircii y'd) por (•(‘iil iiinic (’\|M'I isi\(‘ iliaii IrOlcis to llte 
non*coin area, Ihc larRi'r rcliiriiR from the coin lucn rishiccd IliP iiw 
in lomiH of mill cohIr as low iia 12 imt ccni. At (lie inohl liio actual 
exccBH cKiicnHC IS 80 por cent jicr iiml of n'liiriis 
Tlio pioccdiiro of puyiiifi tins violinia of a (iHCMhonniiirc is TOin- 
incndod, not for mloption, bill for mMioih coiiHidtialion In terms of 
costs it did nut piovc Hiipenor in iIiih niHliinei*. WIk'IIkt on tlin whole 
it was superior in iho present case m a unit lor of iiidKinmU which must 
go beyond llio acliia! data in evahmhng (hi‘ 1 111 purl aiirii of selective 
factors and tlm powiihiliiy that the com ilM'lf wtm u liisliirbing factor 
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I fnrMlrt f iar Wiunf^n 
\ M JOUUAN 

r»iiVfr lU Ilf XhH!i (Virnluui 


Tim i?(or<» ^ffrrhv/* urili/jifK^n <rf «hr an an msfninmul 

of )»as hi-M} hiurlj (lfv<f^^‘^l<lll hut of Iil(lc» 

expcrimonlafinji UriN^nf \vnh^i*s ».nr)i a?r ()/h‘lJ, OaufrmJ nml 

McDoanlil, SlnJM% .Mijr) Munnif laanfiv) out Iho iiml for 

ndcijualo of liy Du^y unjdy Lliat 

assi^nmonts hlmiihl h\* d«‘ar, lodpfol (o K(\oiy pr<i(»(MliirrH; Hlinm- 
Iftlmgj and lluii tlu’y ^lloull^ Hriru^^i' pKililoiiH to Ix' hnlvmd With tho 
outconma of Uu'M' profM-doroH f lii^y liavo nol (‘onciTimd (Iminsoivos* IL 
has Rcainod lo m worHi^sluli*, flior(‘fnro, to nivistigiilo llm ainouiiL of 
added lourninf' wlurh urcruis from (mm»hiu a‘<^igimmiil proceduiCH, 

The ftHsigiiiiu'id proeodmo^, Iim^ \\\ lunuherj nvpio cIiorcu hocauBC 
of Ihoir gcnoial \\^\' rullior limn Ihm'soi^io limy are the JmHt. Tlicsc 
procodurca i\\i\ 

(ft) Tliii pupilK re fiirinMlinl « MigKe«0'il Blnilv pweilurci which coimiHlcd of 
iookina up innirimg of iltflinilt vuirdn, ilruvotiK Iiim'h under Iho imporlaiiL uLato- 
monla, nml die«latemr«|^jm‘Vio»rtly umlfThnod. Great 

caro waa taken In nmko aure llmt ihe pu)nlrt knew oxticlly what they woro to do 
before tliey were ulloweil In In gm 

(M Carefully neloeteil ipn hIiouh nu ihn ninlenal to heatuiiiod worn given to the 
pupr!« before (hey in grin ntuilYmK The jusIniedoiiH wrro '*! want you (o find 
llio aiiBwcni to ihew' ipje^iJon4, niMl nhen you linvo foiiniJ thoiii draw a lino under 
Iho correct aimwer Try to learn no inauv other fnclfl aa you can while you arc 
rnading and Ktmlymg tin* helertum ^ uu are to uho tliean quoHliona aft a gindo ui 
helping you to master the poiiitH firougiit out ni Iho Belectioii/' 

(c) The puprlfi wore taught tlin uieriuing of tho difiiciilt word/} in tho nialenftl 
lo 1)0 Htinlied A Nheel was pre‘iented In the jnijnlft contuining a hat of tho more 
(hflrirnlt words wuh llieir iipprnpriate ineiuunKH wiUi Iheae urntructiona “After 
wo have apent nlmul ten niiiiuti’S shiilMiig tliene Imrd wnnh I ain ROing lo give 
you ft (eat (u see Imw luiinv of (hem vnu have learned Then, (on, you wiU need 
to know lliinr meanmga m unlei lu ainmer (he ipieiHionB ymi will be asked lator 
on 111 tlie passage you are lu read " 

(d) AUenipt wuh nimlt’ In ahnw (he ehihlren the niiiniutr in whieh llio laiifT 
((hofluhjeot (if tlie inaleriui Hludied) ufTeeted tfiein perHoiially llluHtnUionfl wore 
prcaenlcd of Ivpea at gimda made more < heaply in fnroign lamb ilian wO could 
mamifftelure m thm euunto beenuae of the lower atandardft of living obUiiiiing 

im 
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Ihoro Ihnn hero The ordinfliry hiRl* tariff arKiiiiiiml wn« iirtwnled winch cmpha- 
eijsccl IhoolTcol of lowcriiin or rnisiiiR the lanfT on whboh nrnl fntnily income and the 
coiiacqucnt effect on tlio inijiils thoniHrlvca 

(c) In thSa cnaci Ihcro waa a conHcimii alleiniil to cxplnm what the tariff 
was, why aonao thouKht il a Rood nirasiirc, why it i« nillt’d ft protcclivo tariff and 
why it was levied. It was cmiilmHizcd Hint many of the jnipilH niiRlit differ from 
tho President polilicnlly but tlinl it wna their duly to lenrii inueh about a lopio 
dwcuBsed m ConurcHs at Ihol very Hiiic. 

Tho material UBCtl wn.s Holcelctl from the nK’SHaRO of President 
Hoover on the general subject of the tnrilT It consisted of two pages 
of single spaced typewritten material anti was in nature more difficult 
than the ordinary rcadmK matter used by pupils of the levels studied. 
The four pages were divided equally into two sections, A and B, This 
could bo clone rather easily and naturally since there was a bicnk in the 
thought at tho point of division For each paragraph there were 
prepared tlnce sorts of material. Tho first consisted of a senes of 
words cho.sen from the raoic diflicult words of tiio text with multiple 
choice answers Tho second type of material was n test of sentence 
meaning. Caro was exoroised in making the answcis depend on the 
understanding of the Individual sentenee and of that alone. 'rht> third 
type consisted of statements based on the interrelation and meaning of 
several sentences taken together. Bomctiincs thchc ciuestionH depended 
for their answer upon tho interpretation of what was read. ThcbO three 
types aio called: (1) Word knowledge, (2) sentence moaning, (3) para- 
graph moaning, Bcfoio tho experiment proper, this irmterial was 
checked for its difficulty (1) by counting the number of words in each 
selection more difficult than tlio first five thousaiitl in "Tliorndike’s 
Word Book” and (2) by testing tho matciinl on two hundred forty-one 
cases located m Grades V, VII, and IX, This Inst procedure furnished 
us with the following results: 



Word 

1 knowledge 

Sentenco 

Parngrapli 

inclining 

Form A . 

13 11 1 

0 00 

4 47 

FomB, 

14 03 ' 

T) 

4 16 

DiffoTonccs of mcftna 

02 

52 

32 

PEjiff of means 

37 

,14 

12 


The PE of tho differences of tho means showed tho differences 
between A and B in sentence meaning and in paragraph moanmg to be 
reliable The difference was unreliable in the case of woid knowledge 
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Inflttcnfr oj the Amgnment on Learmug 

The diflProncpH hi'lwcoii llic int'tins wrro providptl for by prCHCiiting A 
and B m altorjiato ninnncr. If Hioro wore two grudcs, iu Ihe one wo 
used li for (ho coiUrol uroup auf( A for Hii; PxpprimpnUil Rroup; in the 
other, A wn*? the nonirol nml li, Ihc expcnmenlttl. Tlie correlation 
betwcpn the two hjriiiH \v«.m K6 1- .01 

( JKN'r HM, I’«o(;r<i)i!ui', 

Tlip five {.ituiidonH woio (pKfod in Hip Diirlmm and RulpiKh, N (h, 
acliook ']'»<» Kroiips of /(fill, two of wvPiitli, iitid two of ninth urudo 
pupils wpri' Hti))p>pts for pupIi of llip ^•^pprllMpJllal hjliinlione. This 
made a toliil of om* hundipd hixIj’-spvpu wilijpcts for Afisignmcnt A, 
one hundred oiglily-hi\ for AssiunniPut li, two huiiclrcd fiftpon for 
Assignment C, onp hiindr(‘i) piKhty’-niiip for AHHigninent D, nncl one 
hundred ninety-four for AiHiKimwnt K- nine hundred fifty-ono Biil)joctB 
in nil. Tho same p\(iiinii*>r fHrigf<«) f^avp all the aMigriinonts and all 
the tests to eneh of tlip thirty Kronjm of jiujhIk, 

TliP gpiipuil plan wuH tr» it-nl tlie ehildien fust with one of the 
forma on one day, then the n(‘\t day make the nasignincnt with the 
other fonn and eahnilutp, the dKTpipnecs scored liy pupds who on one 
day were ndlupneerl hjf pertain types of assignments and on the 
other were not so inilneneed, 'J'he tolnl lime coiiwiined l)y tho pupils 
in these iitoceduie.s was fioin Ihirty-fivo to iifty nnnntes 

Ui stfMrt 

The avciage K'SidtH only are givim on uceoiint of the lack of space 


T\III,K r lUsill/rs roil AhStlHMBNT A 
(.‘tuKKriteil Ktuilv Prooi'(hiro) 


1 

Word 

SoiUenco 

l^aiaRiaph 


Kno^Wedgo 

incniifiig 

UYcarifiig 

Control ^ 

ir) 5S 

0 U 

4 78 

Expcnimmltkl i 

\H lid 

1 i; 43 

4.80 

Numboi , , , 

107 

107 

107 

Diffcronco of iim'sujs 


m 

1 

or innuiH ' 

1 

0,1 

3d 

10 

1 


In studying 'J’nl)!e I, om* is si ruck by (lie sliglit (blleroncoa liotwcon 
tho means. In the tteiitence meaning and iii piuiigmpli meaning the 
diUorenecH me merely cliaiioe (bneionces l)ut ni woid knowledge there 
was a reliable, gain due to Hie asaignment. ft is to bo icmombercd 
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tJinl ll«' vrry of .1 hIiuohI f^trcod an iinprovc- 

Tnr>ut III vnrulrtilary Miirr U unions ollwr lliviiRrt of looking 

tip llic iiioiiiHiiK of (iifliciiK wonls Sinrr we hail iif onr diipoHal tlio 
records of ni'vi nd nmdcs il wuh iiol ililtu'idl to not an iivi'rano kiuii lot 
tho year in oaidi of tin* to'-l 'flu- uvi-iav'i' (.'uiu por your on the vocabu- 
laiy leal wh‘< d (17 wordn wliifli i« jiikI nhout (he hiiiiii' as lli(> ^lllprov^ 
moni, of till' vocahularyKrori's lisa rr-iill of this piin-iMlnri' Tlii'mcnn 
Ruiii pi'ryi'ar forwidriioi' ntranniK was v!l ipicstinnsiuid for pimiRtaph 

TAiirr. II- 111 'I'l-T. KoH A‘-.ic.sm>at H 

(A“' i^iiifK nt of lV*rluu’iil ^♦inri4) 


Cnn\r«l 

ExpfTinu'Ulftl 

Numlior 

DifTerfiioo of inrnnH 
PlO.hff of im'unH 


Vftoamuft .TCi c\uc»HlumH AUlumv^U iuouiiui^h of {\w wohIh were 
«tU(lio(l an<l lourru^d Hullicionlly \vo!l to Ihiir con rot meaning 

anionp five word^ tli(‘y were not liMincil hollicicnlly ucll in Die lime 
alUnvod for Ihcni lolnive cnlmnl inin ihc warp and N\ouf of ilic ^‘nlmc 
111 Kuch a inannci as to uupiovi* llu‘ .scom’s on the Moitcomcs ami 
paragraphs 


Wuol Hf'iilvuvc : PrttiiRrivpK 

kiii»ulctl^r' III polling iiirnning 


U\ 

IS ' 

a .v\ 

d 78 

HI 

;ti 1 

a "is 

d 88 

IKO 

' 

ISip 

m 


r» 

• 2(1 

to 


47 ' 

21 

17 


Tmilk lilt lUsiTni*t OK (* 

(IVuHnng M<‘*ninig of Dillinill Wonis) 



Wiir.l j 
1 klHA\Ksl|;i> 1 

Srnlfnn* 

1 iiuMUUng 

[ 

PiiniKinph 

J tueaumg 

Control 

ifj tm 1 

t 

(i :u 

: i 71 

Expcinnculnl 

2 t; IvU 

1 U Ui\ \ 

I 5 04 

Number 

j 2 ir, 1 

m 1 

21 T) 

Diffoionoo of nioaiiH 

1 1 n.i 

2 n 

20 

PlOiiifr (^f niCfiiiH 

11 

20 

lU 


It 18 cleiu fiom Table 11 thiiL Llic assigjumoKi of p('rliuent hlmly 
questions had little if any den wmsli aide rcsalt <ni wmd knowledge or 
paragraph moaning and a Blight hut uniclialilo (‘Acet on iiiulcJHliuuiing 
the meaning of sentences. 



lufimvrr *</ fhr m Jjfnrnwg 


mi 

It 18 ppi»nrriil lliu* tlif iiviir*!-' I< d in fht* (■'({K'riinMiliil f^roiip did 
joflucnci' lh(“ i<r<irf“< in w»«rri Kii'm!* .!?»> Mnrr iiitiTc^tiiiK jK'iliaps is 
iheflinfllt ii)iiir*iM'ii«'nt m junl imr'iKr«|iVi nii'aniiiK wlipii ijo 

many <if dir luirdn IckI Iti fit i* .«tii< d 'I hr inqiroM iiii'iil liunriH larRi't, 
howevpr, mIh'ii (•■iinjtan d vtifli Hi*' ^r.irlv pmwdi nf f>l (lUfulimiH in 
(licscnd'iK'f' nit'Hmm' and »>f 7'i in {'.irai^ra)tli niraning. '[’hi* difTcrcnco 
betiimi (In' ''SfM riini'iit'il niid tin- r<.iiir<t| m word kiinn'lrdt;(' rioi'dn no 
cominuiil MiH'i' ill*' '’ wi'fi!" witi* I'lnuhi tlic rliildrcn dirrully In 


Tii<i» IV III >> I A ft'-ursv If 

(MrikniiS INijiiSp Vflhn< of Mnt4Tjn)H) 




1 

ParnKfapli 


kon'iii 1* 

, HionnuiK 

incarimK 

Coni ml 

17 S7 1 

1) <m 

r> 43 


A7 j 

a 

ft 4H 

Niimbrr 

ivr 1 

1SI» 

ISO 

DiOftronct' of loviom 

7n 1 

• (M 

ori 

PEiu of aantiK 

"" i 

1 

IH 

ficntonco tlio 

lur ‘fiMv-twn ui a huinlicd tliat if Ihci 

exporhnonl vs on* ropo* 

it^ i\ llii* 1 \|>rrinn'iil}il Stroup Nvonhl Htill Im alioad 

of llio cniitrnl prniiii 

In llio V of irira^iaiili nu'uhinKHiiiiilur clmnoes 

arc K'vnnty-ciixlil in 

a Inindri'd 'IVuriim^ tin* iiM'tniinK of dilHcuIt 

as far as carr sholv lias a t lr<*nlod upon fhf" ichilUy to 

comprcliMid (lin ln<^'^nln^^ i»f nnd i)jir!ii!nifdm 



} \ f(t vi i/i » i»r Af'iHiNMnsT h* 


(NfiikiOK J'pjjalx Aw'io* Ilf ri^-io nil H'it'kj;?ronjMl of iho MalM'jnl) 


' Wnol j 

1 , 1 

Piirn^rnpii 


1 ^ j 

iiiouinng 

inomiing 

Control 

17 

0 77 

f) 48 

Exporniiontsl 

IS m 1 

7 07 

0 rii) 

NihiiIht 

I i*ti ] 

m 

11) i 

l)ifTi'ri*iiri' fjf iio* Lii'i 

1 

iO 

u 

Hiidr nf HO HIM 

- '' J 


w 


As a nsall pupiK of tba pia'sonul valim of the 

lariff, than* a fuiily ini]MoV(‘iiu'ut in woul kiiowl- 

C(l|;c, Tho olTo('f4 un *ionU ii(i* nK*iininK uiul pninm'iiph ineaninii; woio 
ml 
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Making cliiWroii aware of tlio gern'ral ImekgrouiKl of the material 
btudied producer a positive effect in the (liiec* tyiiea of iinawer required 
of them. The fhlTcrence,4 me not Hlatislienlly relinlilo but all of 
them arc positive and in tlie. mine directum. Compme these ditfcr- 
oncca witli a yoar'a growtli of 3 08 in word knowledge, 81 in hentenco 
meaning ami .75 in paruKrn]>h iiieuiiiiiK and it ia clear that a few 
minutes of e,xplaimtioii IningH about ' ( of a year’a giowtli in word 
knowledge, H of a year’s giowlh in hentonce ineaniiiK, and of n 
year’s Rrowlli in paniRrapli ineuning It will lu' hceu tlmt the 
improvcmont w greatest in wiitciice meaning and least in paragraph 
meaning. 


TaBLM VI — MUAN (iAINK in KaCII of tub MI'JOATIONH ^WTII Tllf.lll rilOIIAUI.E 

lOnimitH 



Wiinl 

1 

1 


Pnragrapli 

Niim- 


kiuiwloflgo ( 


nioamng 

l)cr 

(o) SuRRCutcd study procedure 

OS' 1 

ra 

oil 1 'i!.l 

(17 1 

19 

107 

ih) Pertinent Htucly (jne^tionH 

- in 1 

17 

1 20 ^ 21 

10 17 

18G 

(c) Tcarhinff inofining of wonirt 
id) MnldiiK pupilu tvvsam of 

111 lisi 1 

11 

20 < 20 

1 '-iOi ( 

10 

216 

pcrHoiuLl vuUio of lunlonnU 

70 t 


- 01 \ 22 

05 1 

18 

189 

(e) Devo loping buckgrouinl 
AvorftRO yearly gum 

1 77|I 
.1 OS 

47 

1 .*0| 1 20 
HI 

11 » m 

77 

191 


Table VI summarizes the leHullH of tins investigation it will be 
seen that the scores encircled arc as largo or linger than then* coiic- 
spondiiig piobablo errors. I'Vom tho slnclOKt statistical point of 
view only Assignments A and 0 me leliable for lu these cases the 
differences arc more than four times the piohabic enoi of the diftoiencc 
Butin these eases the teaching diiectly influeueod the scoies on Word 
knowledge. It le clear that the leacliing of llui ineuiimg of woicls pio- 
duced an improvement in scnlenco uieaiiiiig of 2(5 of a tiuestion oi a 
little leas than ^ ot a year’s growth and slightly more than y\ of 
a year's growth in paragrapli niemiing T'liis omefiil (eacliing of the 
meaning of the moro dlfllcult words stands out as one good way to 
make an assignment. Another method alniiisl an elTectivn is tho 
dovolopmont of a baekgiouud for underatamling the nuvlevuvl to be 
studied. This background of understanding is of undoulitcd assistance 
in comprehending tho meaning of the material stiuliod. 
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GQS 

Since wrri> in* <1 i.m ({mtlri V, ViJ, anrJ IX, 

opporlunily »»■< I'Ik' ilifTi n urml i-fifcrl nf (lie uKhigH' 

mcnl upon eacli Bnsil<'. 


Tjibib VII CdMiMituiM, Hr -.h t,r thk 1 nr, Mmitnw or M,<ki.v<i 

TiOk Ah'Iohkj Hr ffH hur'ttti, aho .Visth <;inaK Pri-iw 



♦ indo V j (irndn VMI • (JradolX 

^Vord 

<* (' i 0 

Scntcnco iiirriiiihi; 

r. K H 


I» K 1 1) 


Tcftctuiimlu* meniiuiK of (lie (hlUciill word (Siiimiimi f) rmiHod Die 
grcftfcfll Rain tit uonl knoivKoJuf* far ('jirli of (lie (liroe Kradcs teated, 
MftkinK pupila nwnn* of ilie p^ciieriil iiifainng «>f (lie mnleriulH (Situnlion 
ri)caufH'() ()H•K^’n^<‘^( lentil in K'lUeuee iin'idiiri^on (lie [mrlof fiflli and 
sovciilti urmle ]iu|nl« wliilt* widi (In* niudi Bnidc il, was llu* aaalBiunont 
of porUfM'Hl qijerlioiiK (jHiinalion U). In lii'vciofnitfc imriiKt'npli moan- 
ing, inttkiuK (lie jnipil*! n^s.lr<' of (In* piTHonal value* of iimtormlH ajipeara 
to bo boflf iti IIm* fiflli Krado, uliile iiiakni^ {iiijiil.s (uviiio of (he KCiioml 
backgromnl of llio inati'rial atudietl ih immt mic<*<’<tHful lu llio sovenLli 
grade. 

Wlnle ilic Kaiiis in (lie i‘\pi<iinii‘nlal HilimlioiH over the control 
situatioiiH nic md wfniiHfically ^'inninoanl, ewciil in two on^'s of word 
ktiovrlwlRO (SilviulioiH A and t"), yi't nur daiiv hIkw hlionn imlicnUonB 
of the iidiuMK'O of (lie nKHiKiimcnt, 'I'Ik* eoii'fi.stency of (lie Kaiii, tlio 
fact llial each lype ciuiM'd a noliccalile piiiii on llic part of one oi* two 
of the grade*! e\attiiiied, (he brief (ime, for (icrtuamtiiig the pupilfi with 
the apcciCic! proeednn* used in 1 lie avsignmenl, and the large per cent of a 
year's gain in many enneH, me evideiiees of the impoilanco of the 
assiguinent. 
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factual .MK.XfOIlV OF J^KC’OXOAliV S(:rrr)OL PUPILS 
FOR A SHORT AHTK'LF. \Vni(’n THKY READ A 
S1N(H K TTMK 

Ai.iiii i> '< 1HM7.I, A\n i; jums 

{('tturlutinl fttun Xi'itiHhrr 

Comparison of (truup Ai'uwp'<' Tsililc VU reponls llte averaijos 
prc,sonle(l iii Taltli's I ht Y* lu muOi a iiianiitT ii«h l« ravoul Ihc, influonco 
of lapse of linio to l*rj)i;^ iilunil of nn nrfielc raid n smglo 

lime. Il ih olf'ar from llml H’llli fi.wnRO of liiiio pupile 

rcmcmlier fewer and fewer of the f.ieh eoiilamed in (he urticios. 
Grade bj' urade and nrliele bj' arliele eijihly-foiir (‘ompiiriHotiH may he 
made helwi'eii “iieee'.'Mve miervals Willi i>i\ excejilnms, only one of 
which is liirjfe eiioiifib lo be >>)f;mlieai)/, (be aveiaKOH of any ftivon 
inlcrvrtl are smaller (ban (bfee of (he iiKtTuds pieeedtnp;. Tins Ih 
notcworliiy in view of (be fuer (liaf (lie fintires aio based on nioupa of 
varying alnlities 

'I’able VIII gives (be A-‘<eore nveiagea foi the eoinbliU’d gioups,* 
Average seores deeiease eoM-is(/*n(lv wilh (ime in the figuic.s of tliia 
table, 'i’lie eonelusion ecenm wniijiiib'd (tial, w'ltlun (bo lirnila 
of the present s(m(y, (lie grealer (lie iiileival between the I'eadiiiRof an 
crliclc and (he siilmeipienl n( tempt to reeiiH ila content Iho gieatei m 
the forged mg for (he fue(s eoidnined 

Iti'htiUs tif lUiudH (iuitifii, 'I'be alxive findingH woro chocked for 
acenracy liy nsiing (he in<>tiiod of eiiuivaicnt groutis One huiidrod 
cases were selected fioni eaeli of the hi\ extioriincnlal groups on the 
basis of A'Scok'h in ininn'diate nieinory in hucIi a miiiinor that the six 
rc.siilling gioiijiM wen* e\ae(ly ef|niva]('nl and lliiil< the A-scorcs of 
each weie noiin((ll3' ilihtiibiKi'd Smee .0().7 linppenod to be Ibo 
A-score average of (be eotnbineil Kiiuh'.s, we selocled 6d 0 as the mean 
and 8.0 as (,ln> aduidaid deviidmn of (he new painllel gioutm and then 
coiiijniled (bn lln'oielieal fii'inieneiea foi hi\ class intervals of four 

‘Bee lirrtl lijklf f>f Muh nrliili in pii'Vioiis 

^11 Klinuld lip jpprDciI llml lliu A-sf'(in‘ avpiugp M*j)UMPnls Ibo woilc of all 
K^oiips Inkun in lurniH of Ibp nuitPiiiil AiKwriRbl 

01^7 
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Ijotnts cncli !U)0\<' iind Ik-Iovv iIk' tiu'an >ti n norniul curve witli mean 
flucl flLandnrd flcvmiinn m tilmvc. hiuI iircn equal lo one hundred The 

Taiu.k vie Avriiadb Mbmomt Arrr.u iJnrKUKNT Intbuvak*!* 


i trfulrnrt 


ialervftl | 

vu i 
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IX 
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.71 2 1 
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.70 2 j 

71 8 
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M \) 

U1 u ; 

3S S 
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42 0 
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;i2 i 

:i3 1 1 

40 1 
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One hundred lUya 


1 1 

1 

20 2 

3. .1 i 

2.7 0 

33 3 

32 i 

Ibvdiiuu 

Immodiftlc 

r*7 ;i 

1 

m w j 

72 1 

7rt 0 ' 

77 n 

UA) 

73 4 

One <lay 

, 47 r 

r>ri (1 1 

r.o 1 1 

1 .'in ;i i 

(11 1) 

72 0 

OS 7 

KourLcen dayn 

; 40 7 

tS 2 j 

n u ■ 

in s 

.K) n 

iO.l 

43.7 

Thirty daya 

;»7 2 1 

,i7 7 1 

27 1 i 

yi i' 1 

13 1 ' 

27 0 

38.2 

Ono hundred daya 

27 :J 1 

21 0 j 

.7,V fi 

;tii ii 1 

1 

:i"i J 

r7'/ / 

33 8 

Arkwright 

Iiiiinodialo 

40 0 

no 0 ! 

no 2 

1 

[ 

77 J i 

iVZ 7 

ni 8 

'll 0 

One day 

3’i r> 

•! 1 

12 \ 

U» 7 

r^r^ 2 

02 2 

10 4 

Pourtocn day a 

i Hr n 

24 H \ 

22 i) 

21 J 

22 2 

32 0 

33 1 

T)urly dayt! 

' 'ifl 11 

27 a 

2ri \ 

,ri fi 

21 n 

31 3 

30 3 

One hundred dayn. 

1 21 ) r» 

22 0 

21 1) 

ts 7 

22 1) 

22 (1 

23 4 


^ Ilakcixcd figurca uliaw RcurcH Ihul hipekor lliuii \kXPi ctUii^; mtoival 
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nccftll interval 

1 1 

VIII j 

IX 

(Irmh"! 

X 

XI j 

XU 

All 

Immodiato 

50 0 

! 51 3 

i 55 5 j 

Oil 0 

02 2 

05 2 

50 7 

Ono day 

40 0 

45 3 

40 0 

47 0 

53 2 

01 1 

•IS 0 

Fourteen days 

20 5 

32 8 

35 U 

20 1 

30 U 

30 s : 

30 3 

Tlurty days. 

25 5 

33 2 

2 i) 5 

35 7 

31 0 

33 8 

32 4 

Ono hundred daya. 

25 5 

27 0 

2 H 5 

20 5 



20 

2 \ 2 

20 0 


hundred cases of caoh group wero then taken to At tiu'so fro(inoncios. 
Kn attempt avob mado to keep tlio number from caoli Rnulo ap])i()xi- 
inately tho aamo. 
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Ofifl 

The rciicicr (•luHihl not*' licit flim iiic(h*Kl innkCM iHtPitihlo Um enm- 
pRrison of (liffcrcnt uitcrvol'^ *»ti llu* lmN|« of n given iiuilonnl even 
though n (lifTctcnl gronji wo** me*! for inch lutcrviil; in the ca«c 
of lifldium we iiijiy c*iin|»nri‘ the n "hIih of (Sroiip I or II )ii imincrJiafe 
memory with (Jronp V in memory ;if)er oncihiy, (Irimp VI hi memory 
after fourteen rinyi, (Jromi IV in iiicriiory nfli'r thirty ilnyH, iiiul flroiip 
III In memory after one Immlreit dnye T'he nix groiipH nn* ulnuial 
exactly nliko iii leriim of A-Keorei in iinineilinle memory. 

The resullH for cneh imiiercil nre jiri'iti'nted in Tallin IX. Tho 
reader should note espeendlv the rhee eiirreaiKindenco holwcen tho 
A-scorc column of the prev-at lahle with the last column of Tabic 
Vlir. Kuril close ctirreHimndeiice hetwiK'n two inethodH of annlyma 
is an indication of the validity of llic* inelhods. 

Taui^i* IX AvFKvm: of P\n\Miri« (5u<n;rB AriTrii DirFKUBNT 
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^ Knell avi-ruKt* w Im-Hi'il nu oim< tnm h, flic A-HCorc« on lliroc hurHlrccL 


Ral(^ 0 / RorgUhyuj A (‘urvt* of forgoUing joay bo ploUocl either 
from tho data of l)w ooluoui in Tublo VIII or from Umso of tho 
last colutun m 'ruble IX. Huch a curve would be representaUvo of Iho 
forgetting of pupila in (tuulcu VII to XII for tho article ''Arkwright^' 
after a einglo reading Th<‘ data of Table VIII are plotted in the 
forgetting curve of Vig Tlio curve m begun at sixty-throo por contj 
since this is approxiinately ilic amount of tho lest which pupils in these 
grade.s can answer wli(*n they an* permitted to look up t!io answers m 
tho text,— f,c., sixty-thr(‘o per cent of the article ^*gcts across*^ in a 
single reading (see sapro. parngiivph entitled, 'TjomprchenBion Dif- 
ficulty and t'areU'HHneHs'^). To enable the reader also to dotermino 
how much of wliat aelually acroHs** in a single reading is remem- 
bered nt each of the intervals, a socond scale jb piovidcd to the right of 
tho graph which beginB the curve at one lumdrod per cent. Tho 
asymptote drawn in lepresmta the oatimated point of complete for- 
getting tor the material, which is taken at six por cent since it was 
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foutnl Uia( rotilil Hit’ w* r (tii* iiiituunr i.f tin* frhl without pre- 
vioiiHly Iminp: mul thf urtirl^* •(t' o , |j;»rjif.'rapli i'lilitlcd "I’rcvi. 
(lUa Kn()\vU>ilp(‘'*J. 

uiul in?oi|(rf »niK pn ‘•‘■iiti'd, \w finO that 

puillls tu till' RHllh « HllHiV'l lltf 'iJ.ll- lu aii'AM T !UI Ilf WSty-tllTCB 

tu'r mit nf till' rpji*''Ui>iiH "W ArliwnwUl whru thi'y ur<‘ pi'iimUril to 
look up Oir JiiiM^iTh ui thi' HTtirli*. tli'il iiinnfilititi'lv HHor tln> muling 
ihcy n'lurinliiT nil umtiw of .'tii 7 |,it Mniitaftfruiu* chi) an avcniKcof 
■IH.O per ri'iit, aflcT fnurlc iii ihiVf* an a\«*iaK»‘ uf .'Jli M pi'r cont, nflor 






Vio, 3 — Avorfluco forKoUinis nirvo lor Arkwn^ht biimtl on A^^h otoh ol nU Rfoupa pnr- 
tieliMvUntt iu tKo 


thirty days an average of i}2 <1 per cent; and after one Imiulietl days an 
average of 30.0 per cent, I’lu' iininediali' iiieinory “ccore reiire.senls an 
average loss of 43.3 per cent of llii' faelH (irei'i'iiled in the article iciul; 
of this, the clilTerenco between one hundred per cent and Hi\*(.y-llirco, 
or thirty-aoven porcen.1, iadue to failure to eouipreheiul tuul to oaiole.‘<3 
wotking habits, and the rmiiuider, 0,3 jicr eent, to forget ling ilunag 
the interval of reading the arlide mid taking llio lest. If we com- 
pute the per cent romemhored of tliiiL which aoluiilly ‘‘gets norosa,” 
wo obtain scores ivs follows: Iininodiutc memory Utl.O per cent, memory 
after ono day 70.2 per cent, memory after fourteen daym fd) 3 per cent, 
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memory after (lurty <lny‘< .11 7 jtfr eoiit, and iiiciiuiry iiffer one hundred 
days 47.0 per rent. 

We, find lierr' (he Kirrie piuieiplr diM'tucred l>y KhhiiiKhiHiH.-'-ma., 
that i« forKedjriK then* i>( a rajud iiiiMnI ht'.n arid a tiiorr* fcradiial 
aubse^iueiit la*'*'. IVe {iiid idw» Jjte ))i/rtri|ile enru>littra(e<l dial Kieaa- 
ingfttlmalenal isfarw'iMen h' ‘.fpiiekh' (hurt noim(*JiM’a}llulile«;aml we 
may add ()m( facts hviraed id a Miifile le idiuK of aa artielc* <if (he di/rt- 
cuUy of Ark»rif(lil are, iii j)ie longer wiJervals at leasi, f»r«ol(eii let'.s 
rapidly limn in DicaniiiMfii! nmleriid in lliefurni of poelryleitnied lo llio 
degree of one eoneet anil DiiiieH)|.«i)ii^ reeilal. In 'rable X we jnenejit 
dnlfl taken from (liree classie htndien of /orKeUmg' and compare Ihein 
jvilh our resullH A study of (lie lulde eliows dial the amoiinls for- 
gotten of wlml iH ucl iiiilly apjireliendi'd of ArkwriKhf. are lei-s, in Kenornl, 
tlmii for llic other nmteiialB, espceinlly after m(erviiln of more than one 
day. IVoin the piwition of the anyinjitole in I’l^ H, it m iilho apparent 
that the iioint of <>oin]ilele forgelluiK in atill far off even after one 
hundred daja, itiid, from llie ehape of the curve, lluit it would take a 
long time lo rtmeh iIuh point, if it weie ever roitclicd. 


Taiii.b X Mf.uoiir Amu DirrmtasT Jntbiivai^ 

Compnnwm of llmillx of MiIoiiaIiioib, Umlosnnw l;cvi lUeli nnd I'iiikenliiiidcr with 

I’n-ssiit SOhI) 
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1' 

38* 
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48 


' IJy iiiterfXjlHtHai in niitlior'a inldci 
’ Ily oiilry Id l''iiilvi'iiliiiiil('r8 tnlilcH of 10 I/ig 

' I'JlihaigliKiiH, If (Af/rr (/(ii OVrfrtfc/ifHK. hcip/ag, IHH,'} trftiislftlcd ))y II A 
Huger iiiul H iliiHst'iiiiia, Mn/wry fluremi of I’iiIUk'uIioiih, TpiicIioib Collcgo, 
Cohiinliiii UnivprHilv, Now YoiU, lllia. 

IUi(IoHsiiwl)i'\Mliip)i, 1* H . lies l'’in tbchrcili'ii ilcn t^erpesaens tml (for Heil 
Dniek dor Dii.leru'ii'Hclioii Uiuvormlort., Itueliiliiiokoieii Clcettingcu, 1906. 

li'inkcnhiiKler, K 0 Tlio Curve of KoigcUmg. Aincitcan Journal of Psy- 
chology, Vol XXIV, 1013, ))]) S-32, 
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Tht' cnnrlu'uin h rvnfhc'<l tin Ui<' l< «>( (Uf nnalyaifi, that 

(a) fordflluiR «ti farl«?il mn"* ml r‘'vl » mjivIc imu* IkIIowh Uiogfiina 
Rpn<'ralUiW uf rftj'sd il Ut'i nii-il nt<«r«' il vnU»<v(mr'Ul lo'^swivi'as 

fowwl by olhf'r invc«<iK»lvrp Ot im im.rv . 0,\ f«rB,4’J(in(^n( facioai 
malcriwl iir«w4H luof'C' il*<\vlv (Imi «if imut'ciiw Ryll&bb, 

(r) (<trgcUittK <4 ftiftu'il iir<*r4 1 1 inurp ‘•ImwIv (Itun forincUing 

of mPiinliiRful mut^Tial >1 l*v aii'l il I'lkcx nnirli lunger Itt 
apprrixiinalt* a jioitil. tuf rtuiipl* tp fttrwpilmK for fndual iiin(<>nol Ihanit 
liopfl cKliPr frtr ruinW’JiW' pyll-ibln'p or iiitMtniiKfitl in'a<*ri:il lonriird by 
ToU‘. It f)io«i«l Ik* roiH(’itilK*n'il Unit tM* hIhim* conipansonB arc 
bctwpt-n mfinnry for facH ui n ‘'iHpIt* reading of nn article 

n« rnpftjiiirpfl by n ifr'ognitwtn (i'»f ainl vpritaliiti iiioiiiory for mntcriala 
learned by role l«t (lit* jKJiitl of «'in* jM-rfrrl mid nnhcsUating 
ropreiclwclion. 

n^,lv\^^v Mtuonv iMKnvaiJt 

ZfttroffMr/irtii - Tlio problr-iH of forgo) ling «ill bi> ulill further 
olarifiod by an iiniilyni» «f lit*' ri lfiiionelnii 4*Mi<hiig iH-iwucn llie scores 
of the ««mp inchvtdttitiK nfUT tlifTrn'Hi iijimtil*', < <' , of I ho (lUosUoa, 
"Do pupils rnnk in iho mirno onlor, in mcnioiy afioi dilToront lime 
Intervals? " Tin's ciiii hr* doiio iiio-*i oxiioiliiimiKly liy die oorrolnlion 
mothod. 

Several workers have invostiKatod iho ciirndadon botvioon iiiimecli- 
ato and delayed memnrj'. Aukiiik iIiom*, ‘rhorrnbko found a correla- 
tion of ,0 bclsvccn iminedialo it’cidl f«ir twolvo nnconiioolcd words and 
delayed recall after Iweniy-fmir InnirK.* Ibtb'f fimnd coitdntiona 
of .73 to .80 between iinmeiiialt* find didnyi'd ri'enll of nonsenac syl- 
lablcs and of biograpblea. Hw Hubjt*eH wen* obtldvi'n in the elemen- 
tary Bcivool.* Bassett reporlH average correlatnmH of .838 bclwccu 
immediato recall of hialory courspa nud reeall after f<i«r inoiilh.'i, .7Q7 
betwcon. immediate recall and recall aflm eight nioiitUa, K30 hetween 
immediato recall and recall after twelve nmuiliK, 8 lU between iniinedi- 
ato recall and reeall after aixlcen uuiiiih*!, .tl8o belweeii recnll after 
four and eight montliR, .015 between reeull after eiitlit iind twelve 
monlhfl, and ,001 between recall after twelve nml Hi\le(*n iiionllis. 

>ThonuUko, E.b,;Tho Itskuoa bi>twin>ii Mvnuiry (»r Wurdn imd Memory tor 
Numl)orfl| ami tlio Itolalion lictwccii hfeutury <iv<*r HUort ami Mcinury over Wig 
InlorvalB. American Journal o/ PsycKoloffy, Vul, XXI, UIOI, l>|i *IS7 t8S 

’Gatos, A, I; Correlations of linnieilinie iiiid Delnved llecall. Journal of 
E^perimenUil Pfycholoffy, Vol IX, 10 IB, i»i). 480-11)11 
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She conclude thul Hnic' mid for^i'UinR tict mil proiilly r(*duro iho 
fclftlivoetondiiiK of pupils m n'li'iitimi of hintfiry lounicd In Hchonl,' 

Tho correlations oldmnnl hj' fh*’ mitliom cif/’il are, in f'encral, 
(ftirly liigh. Imleod, Tliorndikn makoH llie aialemenl, "The relation 
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between rotcnlion of the ofTpola of an experience for ouo or two minutes 
and tlicir retention for one or two days tliiis seems to bo one of tho 
closest yet mi'iisurod in Iniiuun nature.” Ilowovor, wo must romem- 

' DhascU, ft. J, "Jldiendoii of History in tho Sixth, Sovontli and Eighth 
Grades with Special Uoferonoo to the t'actora That Inlhiciioo Rotontion " .Tohna 
Hopkina SUidiea in FAluealimi No. 12 Tho Johns Hopkins Press, Baltimore, 
1928, pp. 22-24. 
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1. the \m\m\ Mi |iii|(il- u ii<i {dulHinly 

mfluhim lllf Hlfioiiiit ttllirli ill! V appr/'lK II<1 ;j||.i rrfiii nib,t, 
should k dn'iW'il for ilio flilfmiHy of 

\mk lo lli(* nliiliiy hd of llir* |n)|iih fur tvliom |j|„Y {ip* ii'iNii,i,i,i 

2. r^'iirdi n* nN'dnl lo rhi^ noiiic jIh* ii)|||.r(,f,i |„ 

rriftlorial it'iid and in llu' lUHilal nf (ii)|t)li whu )i (li'ioriijiuft [||p 
eflicioncy of iiuimory. 

;{. It in olivIniiH (lull II Hiii^lo ff'jiihiiK of li *M.ii i^Munnmii^ m hi, 

in^frinnil iiiHlioil of hlmly Mudii’i* un* jii'i-hd (o 
I'fifcclivi* fiuidy |oclinit|iioH, Tlio )i,sliiiiiro of nfniinn* 

suniiiiiiri?iii(!, m\n lo find mwm (o i)iiri|oii,i liiid n, 

If'nis, lire jirolihoiin A uiil-dih^ iiioio of Miiulur 

m iliniiiRliitiii till' of i; \ Vo,ilti!i\ rct'cni IhhiI 

ikdini nd 

‘L Ollier iiileri'itimR liddh of e\|H'riiii(ii!dion on' mi«hi-h|C(| hy 
slHleiiienh nine, ten, elevi ii mid fioiro (-ii of dio fon |!(titiK Miiiiinmi 


•Tlir MbmiiiII/ih (V», S’m ^nrlt, liu'** 



EI'W’I’ OF oriDKll nv rilKSENTATION ON THE 
RFCAT.I. OF I’KTT’HKS 


iHN'in. I» liItiUtA 


Ilf itf 'rriUol m |lM^ ropnrf wm* nlilainril nt rnnnootU)]i with 
an cxjKTinioni on fli'* * Ih i'< «if prnilfMl iiirnriiiulioa cm luoiuory for 
picturt'.s^ iJia* Inuolri'rl uHcaujui^ ihi^ I'nivc^rwity 

of wmi U*r Mihjrrtn Var irH^iiory malorial bsonty 

uncoltm'fl iMphtrard pirhuis^hf piihum^^mn tlia C’liicjiKO Art InulUuto 
werr \\m\ IhrMtiKl^iuf fcflhnvff 

l A HI \1iili*rtrg* nrjHii, Knitlitfh, 1S7H- (U) 

*2 TIm» Iw A^M^^^hall, is^fl Ul2/i (Ul) 

a vicmn c»f Afr til ?lo» r»f C/dMooi, l»y Dr Mcinvol, 

Krtrirli, PiM 

'1 Ihv A‘l<*h'h 1M*0 (20) 

ft ^Jlir Ttrlwrit, Di»*cli, 10J7 ir»10 (lU) 

0, TifC* Yhniijii ,'t, Uv t J, PVJO PKr2 (10) 

7. Ia J'urmm Ji lirl, AiiF^tniui iR35- 

IDUl {fi} 

H 7 hr \i\ li'rol^^if/ Kfmu^^ fiirfiuifii 1H21) lOlO (11 fi) 

0, IW'iirfrrraM^* I r, hy Jii’i' |r» Hilu ra, ITiSH l(]r>(} (17) 

10 rnrirnil hv Wu MfiuihU, ITiOO lOll 

m 

11 lUiahniollR 7« ItV Unnhaurtl J^ntnlMl^p Vim Ihjrt, Diitolif 1000- 

im (2 

1*1 71ir \Vr* >^lh 7'iT Dh »lh 3»vf^% Ia MOoily MnnV,:uH\, lluiiK**nfin, IKIO-IOOO- 
(U M 

n Njghl m n *’ nf c M tl fi rii^To*, hi Dmu^ (*mrHii*)i, (ioriiiaiii 1472'- 

15M (7) 

M A \Vr ' y (’ntlft, hv Ji oi Miinl (-0, lh4fct<m, IS22 1000 (1) 

ir^ TIm* ' t<f 1^4' \iV&N, hi I VtiJHi ]iik<i>g 7*lu oaikojionloH, hpFiniKh, 

m7 I OH H4 

10 *lh<' lO'|.MO*at* nf ^)lHr II r» I* r, hi Inn ('IihiIih ('jizin, 1 rrneh, 1811- 
P*0| (0) 

17. pyiMiM D‘ D'? Pi' ll* , N)‘'mi» hi I r uih W JlraisK'vvni Knalinh, 

1M)7- (l.li 

IS Hr 'ihil I» \^i<loni Sjn Ammir Vrnj. hv llinijiiirim ^\c4t, AiniairMi, 
l#4S lh,>0 (Ml 

lO *lhr \\ ciiA I Mill, hi' Mnirh ri IhOOn'iiui, l)Jitr)i» 102S 170(1 (8) 

20 Im Ui*ll Ui»I '0> 1^, hi I\ml li in C'hinh n ('Inr, HfIk'ihi, 1810 lOUO (2 ,*i) 

M) I) Dnchi IlihM i>f PnnOil Iiiforiiiiitioii nn Memory for Piclures 

iVi/^rupfl jNV ' JSn |ii , PijM, No 01, 1010 

077 





{m 

K,ifh pJr^nrv iO* t ^ iir<^ 'sn*S Hai' infftTniiilion 

jJw* |^.■r^^f<' **^I',^'<S nr ihr 

ngliR Mf t 1 «r* pjrhur 5vp< ^ ^ \Kf v' n ^>1 r.j filling from 

TUI luif ^riunUToi mJ p^rtuu’^ 

tlu' lri -^1 iu 4 iiu‘ (♦( r, '^nu^J s u"* J,rf Hho jmnUr 

^riiir^ pic^un 'ivrT* f^liMTs iutuSui j4?uj?)^ - uSij#^ < F, ♦hi^n'^po'^iiro 

UiiU' \iA'TUR 1 t( 14 i n r*'Tui'> U*i t \« t> ly nil llir* 

|}IfltlU‘H ru pr# Ul'ol ?!i<" f*'5Jip n ’.^I «!r fOl tl K'pa- 

nwl nU 0u‘ pirhi^ }4*‘ 9 ^ ^^^51 "\ n^rJiS v Mil»j(rM ucrc 

UH*a 1 ^ rtVh uf 1U<* M*4l % '^vU*hU'* uf Tu(<»T?U 

Fur *<fij»lyiu^ Fpi* nt,iu-h r t^f pr^ H riJali^oi and 

frtMjuriuy »»f h^f» nu ij "tlu' 1ip*f ^vu-^ iIm* rank 

wri^hUum Hu*llmr! nc« tiw.c=* rt'uu* I tio* uuuU 4 r uf (uiu*h u 

pirUin* rrr^Jk^^l l»v Uu^ «fh»* laiuulrMi Tin' 

pirliiruH vuM* lliru I.i4jk»*4 i»n hi.]»v r^} Ut* ffi^pMUry of n^call 
Tlio UMin putiurf^ ^->vi joti UtM, fIo* ro-xi uimH 

fn^piriUly h'liHiulM-rMl j^uturn^ pM*i {iiul v^t oji (rank 

mirulH*fH r»f ri'ca)l /jn* i?nru ui kIs^c p < irli pirtiiro 111 

the IlHlj. llu* Miik lorn hi^i''ii fwt^p*M t!** fr* ^pu lu ^ of nrnll and 
thconlorof pru^f^f^riRjiUou tM iw^ tli ’Phu* u'^k iU\o rorrc- 

latum It^urlf^ to Atu^y lh\i tlio rnrlur ,i inriurr u^ proMMiu-il i\\v Ir^sn 
hkrly it will rrcjlloil 

Tlir KiToiifl nuiliuil uhm( ilo< f/rf5pliT»' lii** rvM'iiiy 

picUm’H TVi'n* iJivulroS luUi twu ^rouj^tf' Tlu*' im jnrtun s )>ri*»>^*uU'd 
firat mill Iho It n pirlim**^ pm^-i Mt'i*‘l tri'iointj. i hi^ u\pt 4p,i '* of lln* lunio 
hor of pioluro^ n'riillri] inulor nil’ll of dlu^ < ojifiUu»iiK i*f iiiforinntton 
wtv« oaWuliilHl. "rho'fJi* wiUi tlio Mn\ iivi^r iw,' (or 

all Iho ouo Imiulrtnl twonty auli]! o(^, wp tiilnil 4*' ^1 ni 1 alih I 
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uuniburH from J to VI, u IukIut tiwniKo was ftnuul for llu* ^rooml ludf 
of Iho PorifH of piclurciH 'Du* tiiffi'n-iiff ln-twcfn ilii* I'lhil uvcfiKW 
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(or lnni#lr<'Tl v>iiij^r^w .^n ^^l^irh ?i ronfinnalton 

o( tlu* iihiwt^ niMlifiK Out jo*’*nrt ’ w tlir< MT^airl iiuU ut Ihf'* 

prnoft vii-rr’ r<rillf'*l H4fc'<r<^ (rr^|Uo<Uy, »*?♦ tli*- n^^c*, iltPii pictun^w 
pro^pnf^'fl in Ui<' Irilf i*( 'w^ru^f 

I gr^plnr^illv r* ill* HVrraw**^ plntP^*! uKainnl tln^ 

umniinl <»( iiifdrhiahroi < r<'pr*''^<’nt/i (hi* hrM U'U pirMirc*^ and 



mvn h tlu* HTuiul Ivn pirlurrH, 'Hu* dilToronco bolwoon Ibo Uvo 
cutvt‘H iH n*K<lily ai'vn. b in nuioli liiKbur in all (joiulitKina Utan ourvo a 
ThiK inoaiiH ihul picturaa looalud in ihr Roonnd lialf of iho Horu'a woro 
uormiRlonlly hujalluci rnort* iiinos than thoRO m tlic firAl half of the 
Bono^ 



(^i(( . }1 .'f ?. y? r 

Ihi' ‘w« t'i iKi f iri'in^p "^'*54 ’tarn* <Sivn!i’tl into iwo 

?u!»Kr'>4i5’ir' f"* J<-'sr *tf >i\(* pttlutfti 

if*ar}), ihf .»'n J-Ngt' ■» “-f i'* ■ »U w* J<* >'■>>' l<ir ' «di urwup 

un<l<’r * .irli -sn-J (i.*1'’??'4''”il «'< laM*' I! 



The Lolttl iivewKen for nil lht‘ 4me liikiktlmt iwi lUy neh)f 4 ‘ts 4ir»' 
also inoliKiod in Uio ubli*. AcennimK »■«» the i;<niil (»vit44Ki' 4) (th<' 'mi 
ooluma) piclurca in ilie ilnril (iwurli-r ww' nn'itlh'd iln* fr<‘(iuci»ilv. 
Pictures ioculed in tin* laat qunrlrr Cfuiit* i)4'\t, ilif •wi'kiuI jintup t''*‘ 
next, (intl the firwt Rrewjj in the inat tkf all. 
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mi 

[falit plifiK'sn Ilf Tot !i JI »<r<» m tig, y TIm* liighfst 

cur\<' IS f'lr'i' >)!'• Odpi Rroup r»f tii,v piciun'H which 

mdicfitCH thdt l)u‘ i» iht' }h}i<! tjnrirl't'r iii jil) csr*']!! ihr* 

first ftfifl th<* hfth r-fh'hSi‘''>w Ifi !h< Jatt<r CKXihtifiri it i"* I'tpin! 
with the IhsI «jii«it'T. • nT'i*"* -i r« |<ri »< iitiitg llu* quiirlcr <llr<t|W 
down ntjKfiHlh 111 lhr< iiinhiim »''.n«h(iririi». ('urvit /, nqircw’iiimp, 
the ijijirl‘''r n n nl fr/iin fh^ nr/<i Imvj f f<fF< (-inllv iilidci* 

the end rcimhtDtii'^ 
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Picliirr« liirHif’tt III ilii' lirf‘t miurlvr iiiid hyiiiludiyni by curve u were 
decidi'iJIy friipir'iitly nc'illr'il tlinii |drUit(‘H placed in the other 
three (piiirU re Tins fnci m cU arly I'vnh iil from tlio hgim'. 

An fidditioiiji) fiii-i mny Ih* itci(i-d from Imlh lignrcH winch ih not 
strictly rchib’ij to mir prttbh'in 'I'lii* rclntinii of (he amount of 
iDfurmtiitini nml freqm ix'y of iiniiuMliato ri’cull ih coiiNiHlcnt foi 
all (he groupu of |iirlnrc'r the InilvcH and (he (piartern. All curvcH 
first rise (o (he Heion<l comhlioii, (hen (hey (lr(i|i down to the 
RfUi cniiditinii, and ngaiii ree for (he sixth cniitlilion. The merininp; 
of (hm relation was snhsluntiated in a wjinrnte in licit',* However, 
tlie coiiMsIejiev of tilt' rtdiitiriii is Ihook raentioiu'd heifi for the 
first lirae 

The folIttvmtK eonehiHKtmi may he drawn from (hia exponmont. 

I- The rani, eorri'hUam between the artier of prew'ninfion and the 
fretpK'iicy of imiaethult' leenll m'I'Iiih (n milieale that ])riority of 
presealalii)ii m ant eoinhieive to sueh reeall 

'T In nil Ihe sn eonditmiiH of jnftiimatmn the pimilitm of u jnclure 
iti llie seeoutl half of the ‘it-ries m more fnvoiable to immediate reeall 
than III tlie hr«L half 
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Inint.siM'rint* n |nir«v fmiii iiiHuy Mlv»'rvrrrt ituiinitc thrvl llu; pi«‘K- 
pnc(' of nil niiitii’Mi'i’ fn ijiii uily a di‘lriiii(«iiffil i-fTocl. upon pcrforni- 
nnop. Mmiy iiuIivkIh'iIh Jlinl (lu< prcM'iin* of ollicra caunOH 

thi'in iimny (lilliiiiiiK ^ rtf iM-lmvior t‘h|M'nnlly in hiwpcIi uiul mnoinonin 
rPfliionwK. 

Koii)(*liini *< vtic liiul flini ji roiiii'K fo hcliool, hppimngly 

uu[iropiirpil, j»’l lit* Hiiiiiilnim *1 rliul ‘'Jlr- dnl Ipani lii« Icftson, Init 
tli.'illn* pi'tf niiilij iitd ppiiioiijImt w)ici» i»[Jhth werP whIoIiihk." fCvPr^' 
iPHchpr I'd ffunilinr wpli lliii rir Minnlnr ^ln((’)ltl*)JlH ft/iil hi' fwfjiirnlly 
conKulcrH il h,h ii nu’ri' om out for not linvnifr Mitidu’d. TIiih uivpaliRU- 
lion iH nil iilU’iiipi In ‘•nidy )'\|MTiiiiPidnlly hoiup of l)u> fundumpiiliil 
phaw'rt of llii’ idH*%«* jiroldini. Hiir iimk ih to dincnvor wlictlicr un 
iiidividinil wild li'iM l‘ irin d r’i*rliiui iiK'innry niatpriul, aiul ih llion 
rp(|UirPil 1*1 rt'call tiiiit innfiTial iH'fnrr' a kki'*!* '*f puoplcj will iiH ii 
ronwijupnpo of llif jm tr-iipi* of ili.il titidii'iiei*, Irp alilp lo recall a« 
it'iidily n** whi'ii la* it* aloni* 

I'l'W |H' 0 |ili' liavo roiiHidi r«'d Hip iiiIIiipup*' of a Kroiip on an indi- 
vuliinrH pllipii'iii'y (n riMull wlii*ii |piiriiiiiK tlid not- |)ln<'o m tliiit 
Kroup l.lKiiip' IK till* only antlmr who reporlK any data iioiicorning 
Kroiip iiilliiPiiPi' on nridl nr rvprnduplioii Hi* repoilH limt inoniory 
IK liptler III lln* Kronp Knriy plnldren vvcri* given oiio prehontation of 
a ftprii'h nf nni'-Hvllaltli* wnrd'» anil vspre Ihen palled ujion for a \vritte,n 
reprnilnelinn iniiiii-diali'ly ufii'r llio iirpH'nlalion, and iinnthci one 
liuy laK'r l in-^l, iln* indivnlinilK wi nl lliroiigli (he above aLaled pio* 
cednre aion**, and l<tlpr an in*>nibi'rH of a gioiip Klkiiie expIninH hiH 
iPHiills in leniiK of “rividry ami lln’ in(liu‘iic(’ of HUggeHlihilify due to 
eoiilnet and nn-n’ pri'ni'iiee of ollii’i |H’*>pli‘ " l'llkin(‘'rt Hludy difforH 
from the one repoih’il in (lini paper in niii’ import mil aariecl Ho 
hfndied llii’ niHneiH'*' of a gnmp tni leiuniiig and iiienuny when (lio 
Mlbjeel wuH n ineinirei of fin’ gionp Thi’ U’HuKh ohlained iniiy Ihoro- 
for<’ 1h’ e\p|aini‘*t a-* ht-mg dm* lit iivahy In ihin Hliidy piu'licnlar 

* I'llliiiip, I-' liilliM III I' «l< K*‘m|' ti'ir I't till lullin’ ./ il>' /‘tii/rftoli, 1027, npi 
8‘27 MO 

IlK.I 
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f>Rl 

carp wtiJSUkni hunii's'**, ] < 'Mii-I', ?!’>■ i (•■'innM-liUon, 

Hiid Iir'iicp Ulip jDilij' P’’* VM-n* •< ,-*<'! wJ,M« r/ • jllii-tj; fri furp |K'u|ilt! who 
wore nol f'ltR'ijiPfi m '‘»y r ■i!»it'jr «M'‘ }(< 

Ml v**!* I’luti f III 

Sixty Mmli'iitr*, Hit II sitid Wdinpi), 

frtmi Ihc r1n<ti!« K in utlnuJurVijy .sipj fjinn oilm d<'jiarl« 

nn'isln tif dll' I’luviTfiiy I'f t’liic’if!", )* iriu’ii d iii dip i xjifniot tn 
(’(mf/di+'iif TJkj iirip liixidi'd t»i rrirxloiM iiiIp dim> 

gmiirHi Ilf lupuly r*rtHi i'ii<* 'ipImJ h"! r'.nup!, fi'/iruinji, and 

rcicalliii^ Hiuli*r dip imriii'd nUMiilimi, 'xj»li mdv di<' i-xjiiTimfiKpr 
prwonl, (iniUp li'irju'd »»'{»'? div mu' ♦ «si*liii«iii did Rfou]) 
ono> liul they recalled mid rrd''ariii'd l.<fnr»' «n nur!imc<' ciDiinHinRQf 
four iM'ixujriH wlin i*Jd in die r-xiM riis.' id il rituni indiKiit iiHjinn any 
ttllcnlioii In dii'tn The nf jirpiip ihn'e alw» h.inif'd alone, 

and tilt'll recalled and nlennicd lifer*' »h iimli* nr*- TIiih fuidiciicc 
however aUeiilivcly walclicd ami Vi pi track «d dior rctiHiiiw't* 

/Inditiirffl, Tho fiMdii’iic' k cmoi-tcd «d in* n imd t\sti v.itim*n, 
fill grotlaftle Kli«lcnl*i or tuajors m j»'*vrli«*liiiiv. Tiny "cn’ cdcciod 
wlUi ft view Ui their (DretiK;*' in ll)<‘ i'y<'K id die niiIijitK. and hh fiiriw 
poamililn Piinaitiled of f>cii|di' whn \\pr«' iml (i<ajM'nnti’d with tlio mil)* 
jeelw. Ko nllt'iiipl wiw iinidt* l»i hM-ji die "uimi* iiidiviihinla for (i)>cc’ 
tnlojn IhrriUKhoul du' I'Xirrlini tit, y\« h.-n* idr»-!i<lv Im n mn-’Ki'iilcd 
two kintlft of fttidirncoft tven* n»ii>li»y«'>l: Hm* i» wlnih tin* itn iulwm 
paid no ftlLcntitm to the wthjiTi, Imi were mt-rclv |*r< -< m lu tin' i \|Hri- 
mcntftl room: Another, nn nlleniiu* miiln nct', lli»* iii«iidH*rc id winch 
lifilcncd (o lliR Riihji’cl mid checked hm n viutiiei a nn n "liii id |i:i|H'r 
which conuincil the liwlx uf words in Ihur eern t ( nrli'r 

iWnferiftl. The lualerijil In lie harned ennmsted id a list id lifti'cii 
pftira of wonla which hud Im'ii H‘h't>l»‘d ut rainhiin frnm u hiaiidurd 
dictionary, lu conatrucliuR (lu* hot euro w.ii taken timi lui li'H'r 
should occur twice in a gixeii p'lir 'Mie word** wit<' I'xiie '*d liy tiu'iins 
of a hand*o|K)ral(!d iiieiiiory driini, u i'(’tiic|iirii iielninient in the 
Iiiborftlory of the llniverNity of Chleiiun hi In r iiriii'ri'ils iieeil were 
enrda three to five inehea with llie n"*|MU)m< word i eoini d on iniorre- 
Bpondiun ortler with tUo hUhiuIwh words of th»' icii ccrii’i, fur n'rordmn 
llio resporiHCa. A aUipwuteh werved fur imung the expumire id (he 
paired aiwuciulcfl, 

rrocedure. The piiirod awmeiule IinI wih pri.-teiilid once, allowiiiB 
three seconds for encli exposuri', after which the miliji el waa ichled for 








rtCAll. 1^? ^ a«i,j,fj J-r VjdV^j 

in a ^'/jj" jii ^ ijfv i-^jafK^^diT 'i, ;^Taf( Uio 

euhjrct Iri^l Kr*< Mi« j^r- ;•* r 3*^ ^V '^'’''' ' j-S flK- yrA^^ra tun<» nf 

Ui .r» <'i9N’i H ri^i^is ^ ^pi ri»T»’l?}}i:;r^J S}7i5j| ?Jk'' /^ ul^jrrl 

Ut ?;>< < "!v v^rv on hf-? 't'hr* 

cril'PHf’in <4 ^ ^ » ■» < (r jjr..Tlr i>n. \ piili^rrl (r^tfitnl 

thp Ufff< ;> i*** 1? iT^pJ sitj<l ih«MTi 

im’nlj-f'tur Uut j *i%ti um**HU^r nr in 

•'•-o 000 ''^^ n^n<f\ »iijK»n thf* 

paHiniliir cx»ji<fi}i‘'iniii *U 'f 
/i74r/'f!' V it.* !'» 

r(K}«inr^) 5n n i»«J .i i \»u\^,ii^(\ ^ypm'nH4?if iiHinn^ilnri 

idi^r ^U\rh U* w s^^5?^^4.^ J>nc*i}y in i*raK<" n^rKtiin ihut ho 
undt^rMcM^4 Sh»' if* j.* r il u / ^ f h?«^ iirml. \i Itir* ^flhlf^ itiiso lir wttH 

aUo loM VHul^T Wih’ii )vt* ^ i% * \}Hri<r ,} Ui Trr 41, iiinl n'lr^iirn 

on iho hsUnmn^!; 4 ly 1 hMf^ r i.^ r> fl>ih|^'<t !'< fnrt* h»" pU^rK^^d ?o 

l(<arn, ^sh^'Ui^r niii , niid 4 ^iomI ofwn nmlunci^, wft-« 

lo pro^ ni fnr t** '^ll 

Tlio nftly mh}t tfjf n m‘'Jj<t on^UnriiMOiH nji flit^ n'rnll ilfty woro 
tho^ tthn Vinr ?n n^hr jindw'iR-f* 'IVj tJn-jn, iho Wfliw^l 

tt.iH nuulo in '^!<ii)Hih4 find Inmliy, (Inif ovrry jK‘W)n 

in Ihr mnm wtah '45id ' U h<r ^ » \tiii nnli r wiiH | 2 ;i\ pn In ('nhoineo 
ihc^offt^atiVfiuM ui i\n nUM' Ur^* iiomI ihib In furllifr IncrruM) 
(hf^ l-p* !«pt f 0<n jiJol riln nlt\n uudh^HOf*, 

TrrMmcni n/ IhiU. ‘Hm* f4ni*>innt nf n*K4*htifin in MnU d ui tonnH of 
(1) nuinlK^r uf waxtU rtr.dlnd, Vi) inmi]M*r nf tnulw ro^)nmMl in rnicarn; 
m\ (3i piri^ shhwU vwninbnuin^d li,v ihn Mlowni^j formula: 

) V* ".‘'''"r”Vt»» 

y Irrihlnu Mni J 

TJk* diffcrvupi' III ^•(^u'^l•llrv nf n'l’iill lM‘t\\i fn (fii* tmvc'ral floiKiiliruiR ib 
( lc(PriniTii’i| RPiitihPirilly uinl Ptic n‘Mll(« nrf ulaU'd in (priiH of llio 
nuiiiprictil »lifr» r«'i«'- \ lln' hm ruKi t, lln* jiroliiil)!i‘ (-mirH of llio menus, 
till' difliTi’ijPi' lw)H»cit ihi* Jjit'Miirt, iiMil {})(• i»ndml>](' I'lror of ihcir 
(tiffcn'iipj's 

Uj.Hl'l.l'H 

Tnhli* I Kivi'rt pJm* t<i{ul iiritl menti immlnT of words rccnilwl, Irinls 
rcquircif to ndfiirii nii'l tin- saviiit? Hrori' foi (ho dilTcri'iK oondilionB. 
If \vp Hiinlyw ilic ihitn ii np|H*iirrt ihnl (Im roMiUa in li'rniR of ic.call ino 
niDsl clonr ciu, w)il!i' lliow) ui toDiis of ri*Ienniinn nnd savinK; allhouKh 
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Irfj. Urn^*, fj J” >('!<rnry 1 (iP » Jtmi no <»( tcicnlion 

«•( Hit ii 111 “-"tn-’* ’•? Tvf 41, iU'i »> ,\viits(,, i* Rfi’aUHl W 

«<i fnul«ncp. In "liP i-f mk .iis>i,<'fsrp, inpl jii ivmlwnw, 

Oip rnnmniMl ‘-f-'n p f>*r p *' ,ir> Mn'-ilUr iliun ihop,. 

fur ii't niuiutin% whtl'* I'M Uip «ii!l.' r li jipI i ijual for llip 

tiMi kiiifUi (if {tinln 'I J)f 'll pignilK ujir<! of Iht* fiiulitigii m 

rlntwni in «lip lairr ili'H r* nl’a Jlirow tifijit tijHiii n futiila- 

im*nii»i jirinniilp nf p jiNpIiir’i")* 'llo) >inlicft''f' Uial tiny iitiinuluiu 
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HiluiiUnii iMUHl In* oniriilpri'il uN « fuiirlioiial Vilinlf ciiliHthliilii 
of a cfinHli'llulnin of ininn*ro»itt orK'Uii''imp ninl focloni 

Any chango in llir i»iUm(n*ii will iiffi ci lln- ontln >* 1 ** of iln* wlinli' If 
n bolinviiir pullcrii ih oncn fonitiol ii imiy I**' n iimi'di iJ In m n Minilar 
flilitalion (o (but in it wan oriKiii iIlv Mii'i|inr<'il In our |irobl(‘in 

mil only Ihr lolnl or^nniioititin proM'iii ni tin* liiiio of b nrmnn, Imt Ibi' 
conalolbiruia of orgnmHiuo nml iMiviromni’ni'il f.o'toin u( llo' luni' of 
rccftll \ser(? cijnuUy iinjwirliUU in (muUl’.Uutv'. or inlnlnliiin ippouliusluni 
Table II hIiowh (be niean uiunImt of ivorib^ n'eall' il, <*f trmb 
requirnd lo relearn, ninl of (la* miviok pi-r h?i( for < aeli <>( tie' loo eon- 
ililioiia, no ntuhintee atul anilieiiee; (bo proli'ililo onoij< uf (he tan 
iiictuiH from (be (lm*e enieria atul (lie probable < rrot^ of tlair differ- 
encea Then) jh a ibflenuiee taUMoeii (be iwo eoiubdoiiHi in all of tin 
tliTco criteria, 'rin.' one in lernih uf roeall ii abnoil fnin (iinei ili 
luobablo error. The tllfTenuieeH m ibe lU'-e of iho ^••leanuIU^ and 
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f^vjiip; uni i^fT' sK, u i t?J,i V a n*!iMnC<'nt tvinfoiicy, 

TM H r^fw"n/*lly rf'fipnrkfiM^* nut *' 'IIh ^ jjtf* )i(#! ifijn'rl mu ?4>?ai)rf*H 
of mwW 

rAni% J1 in Ihrr^i^^vsfti ir^inv^ifin* \p* ,%m» ]'i477isynr 
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in TnM<* III s^i* l(n<t tli** no^nn rnufr^Kr <ff (fu* \Kut<h rt^cnllcMl, of 
irmln riMiulrrtl U) ri'Uurn, iittil i*i fli<* h'^vjng jht IihL for oarh of llu‘ U'.o 
coiuhtionN, no 'i\ninnir><‘ uiol 'ilU ritivo onHuTiro, tin' prol)al)h‘ orrora of 
tiu‘ Isvo iiiorina from iIip ilir* '‘ oriU‘rta, ninl tlio prol»alplp* orror of lluor 
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Ah li»'f(tr<* w,. Iliul llmL (lu‘ hul)jcclH with uudicnco give poorer 
rcHitllh 'Dll' diffeii'iice belwi'cii no uudifnce mid utlcnlivo lUKliencfi 
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rivh^til'iiK^T W^urfjy ”^n^lj*^T<*r<- ^^nf] 

l\\tt 'f^.^^'’y*v ?K V Wr^'t‘an wHha 

♦k^^if'rtn^y s^'Wf‘» 7 . «- } 3 7'? iiii<3 lu-tfM^^^Mrrorrjif tho 

d»Jfori(nnf> V)^ ’^r* ^^‘‘.^jril rhfton^ncc 

ThK indi<'aU^ii ei h%^h it^r 

TJnf^ }>« r{*rnr* 1/ i>t^ p^n\vUil yh* r r iht^ flifirr- 

%n ivjv/<’ i4 tL*’' ^l»< u ^4i, >tiu nn [\vm^, 

1<it^ll^f JridTifi i^iAtfil i?jv/-«nj I'^'T's ^hiu rv ?«8i?iri|mfin^ an 

tUi^n n * ti tiM ^ > 4i \'^ * .‘^ji*<’rimen!or 

\\V ^cMK^mlly Jitid ^ht^^'' ii I-t.^ik^irT JorinrH’, i^yj^''!! sh hy \h{^x 

rrc^H t *11^ r?iN u 1* Irarn* 

u>R K nw li'^uHiTiMM^ y <^^ :^n nMdi< \w ni(* dlv 

cii^uih nf JhH wsJI n»* u^ instil r 

TA^^jt IV Inv llirr^ftWHf'it \% u^vwt; am^ 

\l^^Jfl'*i 7 iH JE At pOW^k W 
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Table IV given the m^j»n nu*aU*r uf ivord^^ rr^rnlh^d, **( trtnU rvt]vnn*vl 
to relearn and of tim biivnig |mt hr^t ff<r r.edi itf tin* two (*onilit nan'll 
nmllenUve and allentivn punlirnre, 11)10 imdMblo errors of ilu' two 
mcaua from the three criteria ami tie* iindMldo orrot.-^ of tluir ^h^f^*^ 
Qocofl. Them ih pmcUcnlly no flif»|innty Iw^twron \)w n^nnlH for the 
two klnda of amlumeva. 

It Boema llmt tlm kind nf auilinnce ik nut vc*ry ini|H*rlanL m< regardK 
ItrB influence on recall, However, mir re^^uU^* may Ih' u funeiuvn t>f the 
particular BiUmtloii, And if that Bliuuld In* llu* oHiit gnnip urninKr- 
monls might have diffcn^nt conm'tpumccit, Tlien-furi' no general 
conolUBiona cau be made From the viewjuuuC of tlie orgaiuratuni of 
tho audienccB further obBervationa and BludieK wniild )h‘ cieBira))lo. 



lh( t'i ft"! iiffttri lifJ'.tjU fthSI 

Tablr Ibf <Ju*-4 ••ji Mic KnrrunB r,f i)n< nAf4<4Ciatif^ 

/a flit If'rirJHJjfi; ■♦■•'A {<1 1 *'*” imlv »h<‘ f xfK'riuiPiitfr prcw-n* 
ThcBol'' fiidfri Kc*’ I n '.J Irnnisiiir’ r<<u*l5H<inM wivn lltal, iit 

lihe fiR*(, tlir' pulij'c*-) .h<J i,«»’ •'i.jj'rl hn .oi<Ji' i»ri\ while m (lie oilier 
two, N'a'oriUv wr H'>uM ii|,e lefirmtiit eflieienoy (o 

be hIkHiI rrjltnl »lirfOi«h'Oi* »he t ti)® niie iil, nr «» le'Wf} ri„t (i, vary lo H 
ffffAler ileRh-e Ill'll! tmuM l-e < %jil-jiii«'<l eii« line u, Hianrc. Yet we fiml 

that (ejirmuR wrw ro* 111 *' ttvef-ipe rouoiih rolily emoer when the ftul>- 
)CCl# flul It'll e*»t«e{ riri ;i'|tls«'jief *lh,. ihtferenre m innls required lo 
Ifiim (lie tm-ni*) of iiain il a»<«f !«'-»'« wh'ii 'xtnifliiiR no niidlencfi and 
when nnlirifwiinti an nu<h< ne"* j« o t«iia| of inalt or a menu of 1.40 

Tabi.r V Tiik Fj'I'J’" t f uri ' k * i,f t oi> Ai niieint »<t« R»cai.i,, at tub 
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(riolfl. 'I’lie prohihl*' error of (he diffen'iire of (he (wo inuanH in .45 
The aetiml ilihimrdy in u fitile over (liriM' (mien i(h iirohalila error, 
mdicaliiiK MKiiilieuiire 'I'here nre no mKidfuimil dilTercncOft for the 
two diffioenl kindw of lUidieiire-i 

The. fart tlial llie iK‘o|i|e needl'd niorr* tnalH (o h'lirn (he iiiiitorial 
when tliey wen- e\j>ee(m« nn imdiniec nmy Im' esplivuiod aa being duo 
to differenee in anUi'iieiluiii, and iniegralum with reference to the 
learning ailnnlion AiKieiinUing an audience Heeincd (o have been 
iiibdnth'i* lo (he )eariiiiiK iirme.'i'i ‘I’Jie Hiilijeela’ reporla clearly indi- 
cale lha( (heir knowledKf of having lo reeall before aiieclivtora cuuacd 
Home nneaaineHrt, 'f'hey a|t|H‘an'il lo learn wllli the mlenlinn of know- 
ing (lie vvorda wvll, and of l«'mg aide (o (ell (hem lo aoineliody >Snoh 
an alliUtde waa not reeoginralde with (he mibjoeta wlio did not look 
forward lo an andieiiee; (lieae hulijee.la appeared lo learn without any 
definite end in view, 'i’liew* are tiio faola a« llicy aro before ua- Wo 



I’J K<h4f }'ty< 

(ytnrlu'}*’ «!?*’»( sfni? ^JsffK "i m r«jj('fu4 mniiliJjttuft of 

raviw' forif (URf ft ?J»f« in ? tl*' of I" rinoiiK. 

i!k* fac'tt ».« ilo y ir fr^oo cur iroi.) »'<tR44ium wcfin<i 

that ' 

I li loiuniKg laVr.' itlnrio 0 » j,rr »« roo t.f a ftrtnip al the 

IU!io of H'r,i!l >B *lr-!nr(K i»Jal oflsfiOKy of rijjftKiurSiun 

'i TIm* hiH'i of AU'lft’Uri' i» i»»'l vtiy sws ffptrtU ili. 

indui-nn’ im ToniU Umiovor, i>. uisiy ifci’S m »l«fi I'ojiutxtHjn iW 
rfMillsjtn* rt funriioji of 5ho |f»r^^ru}ir fuiU's^iiui, aJul ihsil ollifTRroup 
nrrttflRrmoiitiS iiiiglii In^r liiffoM ui riitftj <(U''ik< « 

3. Tin* «mint*nJicii of an moU'^nr'* for r*T4|l, ni tin' hint' nf Iwm* 
ins, iurrriwx-H tUf {wkrOiftK iftftO, a«i3, ft< fijuto ,3 ihm, Mh' aitionnl 
JT’liiPluln'rftl in I'M* wlu'ii ftriU orriirik f'^fcro tu ^loli' iioo 

*rhm' n-flulliff ilt-'j* >1*" jiuffil whu i ctii|i)fft»#i of rttil Ix'idx 

able (ft rviiu'intHT vicll a Ion mpji I'U <? I'm o' tie Uforo a (■!,»'•« titay not 
bp Iryniji lo pwajH* ft'tiwtUHluli^v Hiw >urtb»bty sn fvrall ft'\<’nla » 
fundaniciitnl farior of niouMiry, aM'I rbowu \b«il Jho aihJaliofi dining 
ihc lirripof IrnmiriR and tliinriK Dio ifto* ofiM'dl ir« i'({nti))viiii|M)rtani 
in fapililalitiK or iitlulniutR U«o n 



TIIK IlICl.A'riVK IN’Fr.t’KX(“H OF VlSl'AF AXl) 
ArUUTOKV FAf'TOKS fX SPKLLfXc; 

AlUIATY 

(.Otllc.K \V UAinNUNK 

I>rJ»’»ltri|rn( Ilf I’FHi')if«5i jji, I'l 

A JUf su or riiJ. Ficojii.rw 

Tilt* of ilir ftvi'r.ini' iirotfrffrmliiuir i» noloritum. One 

aupprol** dial flo* vo-aT of oltji rlivi* r.viiiiiiiindoiia inuy lie* jiartly 

pspinmetf hy du ir r >0 olloMiiO* iliio lo illr*Kiltlf* piijiorH, 

cliaRviHi nvuhvil l*y rlnl*Ji‘'h atul iriilulion Itorn of ropoalod 

*l 111 *<■ 1 '*11(11100 (Icid ii-ui'ii H itrc c*t*|MTKiliy pioioinant in 
HCiPiin* nnirw -'tttn'rr ihi'ilifli* Miin n of n(!i‘*foriHf: a ((‘clniiciil vopiiluilury 
«p/w)l dio j'tijM'iior ^iMoii'iP IJow iiirtjiy riwlorti iiro Ihi'rr 
who nfliT t'\|«>siin» tliMi* I'ldirpt h (o H >t'ur of in riiiitriil liiul thoin 
afiolljjiK pf*>Tljoli»Kv oiori’ Jik*' |ilo!o>.oj»Jjy, (>)iyMotofiy, mjmI pliiloJoffy 
fimn liko 11,1 own inn* h'-IfV 

Tilt' varioiiM t‘x|il‘m!iliii'nh «|(irli liiivc Imm'Ii mlvunpotl for Hpaciul 
nliilifir'rt nrni (lt^(^|p|h^1l'H nw do y inmiifcil llicoiM'Ivca in nriKlpinio or 
vnt'itdoliiil In'ltiti no* mikW‘'‘iIim* l>ui lianllv piinvini'ini; In llio cuho 
of mirli u n-ntririotl fnin-lnin iih j*|H-)linK, 'f , d ih I’lo^y to (ir'inoiiHlrftU' 
dwii ii ix not nil oatIiimvo |irn|M riy of liifdi or low iiiloUiffciu'c, iillliouKh 
il IK i'i|ii!tlly t’orfiiin ilnit it ix not ok iinii'iii'inloiii of f'l'iiornl niilivi' 
nliilily IIS KoiiH' I'Mri'iiiisih wonlil Imvc us hclifvi' An ininlyHiH of die 
connnoni'st typos of orroro Inoh to llu* hiisincion diut viirioim soiiHory 
flinl iiuitfir nli<ifi> niTiO'it's mo tin* nmjor ilt'torniiiK'rx of pi'r/ornnincu, 
lull w/nf/i oni t nri' criii'iikl is ns yet iinkiiovMi. 'I'ltc cxirronl viinv hcpiiib 
to 1«‘ dint I'M'ry jxior sih'IIit imisl lx* indivnlimlly dinunosoti and 
Hportlic ii‘iiii'dii''s prt‘S(Tiln'il an olivimis (‘oii'-i'ijiirni'i' of an implicit 
l)[‘lii'f in plural I'lnisalioii 

However, the M’lenlilic seaieli foi iniciiniile Konenili/.iilionH m 
not lo lie dismissed so linlidy. .Inst ua il in [iroliluble. to know llmt 
KiijK'nor intelleetM lend lo liuve eoiresiioiidiiiKly licfler jiliyHUjiu'H, 
einolioiiul control, etc , no \se oii^lil lo know wlinl die nininliciuit 
cliiiiiu'lenKlicH of Ik good speller are ns distinet from a l>iul one. 

Among I lie niiiny I'NpliktliklloiiH mlvancetl for poor Kiidling, perlmps 
die inoHl rconrreiit om* ih dmt wliich utlnlniloa it lo Llie non-plionotic 
niiluro of die iCiiglish Inrtgiiage Woro cerlinn fioimda uniformly 

out 



7‘A<' <■/ f s /*r y, ?■„ f,.35^ 

n Jirr'f" by rlirfimt*’ b -jb'it*' Wiuibi Jn.’tlttnlp porred 

sjK’lliDK- TIh* Bflvwa!''/ -i T«'b'fJii.‘''l ?)■»< .ijij'.jrrnlly hiko this 
M>rn»iifi|y, rlfhtnfp* f sV! "b'j* r.7}i'}» mil) n Juj^cly pfmjj 

ftri|UPttpy in liiRlily j'bi.n^^v.p p'lrb f u rnroi r>r J'pnnidh, A. 

pUjiiiUy itiiirp ttlmwjl'b* *.i i1u« fljjimii'ni i« ibi' »f « j^ptmin 

wniUl prorimiitt^ w<iji}» rofirrMv l»<' w«iibJ buM* nei iliHiPuily wiih 

Ihc'ir orthfiKmphy, 1 ijf<*r5m')tj'<'ly, ibn (mIf* <« Mrr(nu)> for Jlip fad 
«!mt many Arnprirarj*' r.nu fpH Kirnirl) rn/» proj-t rlv 1ml itniiiouncc 
tUtm In ft wry iiimim> r; ««»} niuibirSy bir lUf rtcttclimau 

UKtiB, Knftlijili. Mt«n<ivi r, n}*«sl mi>F-jv< JhiiR-* urn j'nlfMiuilmnji or 
diBplftpcmmifi I'f Wuj-i «ihirli b\ «*» nf DB'jKiuntnm cnn be 

ftllnbyU'-d l«» fawby pr<m<)mip}aft«<n. Tbf* »b plimiiijititm of the 

pronundfttian lla-ory «»)iilij pwni ?«* Ii' nv vi1,iMp r<‘i)fM-ipirMtr(> of Ihc 
(incline IliiiJ ^l^'»f•»lul<?l aiP ri'iftiiNplv l>piU'r in rjH'lIjnR Ilian in other 
ftchool Mibjprt#". 

OlliPf Yjpw]>fiin<*i b’lYP >(»i‘ tM»‘ «f viciml jn'r^'piion. 

Hmp l)m cmiiinriiii’pi npinaoit is Iba* iij«r'ih'rf« ririF (IdiPiPiil m 

vfMtnl niififti'ry, Imi ilm iin lij«l*M'<«pir ppnn ni nppr»')it'i(>*iiiri Itns bIro 
licon cmimtlprip*! «k (hi* •lm«i\i* fm ’or 

Wlu'iT Kuch iUv<«rp“ nml rftn*rft4ir(*>ry <(putiMn« r-xie*, a nwirt lo 
oxfx'riiwnlftl ftilaipk i« imhrntrd Tn iln- wnn-r, (In* j^uMiao plmwd 
lluc'lf an followK: 

l)tK*a cxcplhmrp* of tmililnry nr V(»iirti h rn*pii\i* ritp iPily pliiy the 
doininniit rAlp in m«*Ilin$j jn-rfnriiiium'? I« pp'lliiiv; abiliiy more 
cIoKcly tiftWicittlml mill Ihnin* wmliMriK nipiiintid bv lln* i*;«r or willi 
ihow involving; tin* i*)***? Tin* wurilin^ of ilivw* »pivHijt*na by iinplicii- 
Uoii minlinliM'n the* inlbicnn* of innlnr impnlfimi-* «** it nsmnu-il that 
chance fllipa of tin* im*ii Hhntilti ncriir »'i|milly ofu n wuh both uroiip'i, 
and il nltw bpIs iii (lit* Imckground ihn mlliu-MPi* of Bin h pi'iilral fnetore 
aa intclliKcncc, lype of trllH^l'^y, naMirmliniit I'ti* 

H. Tub 'IThtim. I’nio i m i'»- 

Tliio uwcfttinatioii iK-gfin by adiniiiiBU’riti^ in birni* n impli'a of mioh 
collof(ft clfiHs from Frwlirinm in fv-ninr fmx: Iminlrcil lliirly-HK cii^ph 
ill fill) n lOKl coiiKWliiiK nf fifty wlwli'il ivnrih ii(iiw*!UiiiK n> both 
the Thoriulike uiid Horn Word HtHikw. I’p***' prcjmn'il bIippI, I lie 
8ul)i<'clR priiifcff t'licb wonl as it, waa ajHikmi and hn nii'iuiniK dluHlrub'd 
by ft ftiimplp Benii'iice. Tlnit Ibn tPBt wiw « n-ii'.onidili' im'iiimn' of 
BpellinR ability ia indicali'd by llio relinblhly tfoolflpimit of SI 1- 007) 
obtained by thft sph(>h«U (ecluiique For the piirpoM'H of iIiih evpen- 
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incnlj rf'prcwiUiUivj' cuwea clioaca from the tniddlo and both Inilfj of 
the (liHtrdmtion were Bclpclod for iiilftiiHivo Hludy. Sixly-thrce 
individualH wore ihiiH obltiinod twenty-four of the best KpeUers, 
eighteen of the |i(KtrcBl, nnd twenty-one iwirage ones cetitenng 
aruiuxl the nicdiaii score. 

The following t4'Ht hories wna udniinislered iiidivhlimlly lo each of 
the Kubjet'ls 

Tial 1 . I’Lrccplual Hpan fvr Matnmy/ul Material {lielialjilily 
.7>1) Upon ilio mnldhs of twenty wnnll while cards weic printed iJic 
following unusual words, derived largely from Whipplu's well-known 
information teal; 


ageralum 

simony 

( 'nedmon 

synecdoche 

elcMslognnums 

Ircpliinc 

gneiss 

Inlolnte 

guiinjHi 

Weismannism 

hemiplera 

onomalnpoem 

imiietigo 

sphygmoinanoineter 

iidtiglio 

exoplillmlrnic 

inclucari>al 

AliderhnUlen 

iK'iiopliiin 

I, a Uouchofouoaukl 


()ne-»i*cond etposuh's of the oards weie mado tacluBloscopicnlly; 
during the intervals (wliieh vaiied with (he wiiling lime) the subject 
rccordeil the wor<i he bad seen 'I’he total number of ropioduclions 
correct in every detail const iluled I ho seoic 

7’efit 2. 1 imtl UtmjnUum (/fc/ml»tfi/y ,01). --Twenty common 

words jirinK'd <tn eaids were expoMul lo the subject at the rate of about 
one per secoiul with m.st ructions lo (ixalo each item Immediately 
after (he ciriginal .senes had been wen, the caids woic shuffled with 
twenty other eon fusion slimuh. The mixed set was then lu ranged 
by tlic suliject into two piles one containing the cmds the subject 
had H'i'ii and I hi' other eontnimng (liose lie had not seen Score = 
2 X iminbei nf eriors in botli piles subtracted fioin 10 {Vor the 
exact items ».ee (In* list in the writer’s appendix lo Arelnm of Pay- 
ehtiloijy, No 11)11.) 

TiM :1, iS'fh lU Hi nihuij. Wliiiiple’s Iligli Koliool and College l'\)rm 
1) was adnuiuslered in iieeordanei' witli (l)(‘ lime hniits and otlioi 
coiulilioiiH speeilied in ins diii'ctions slieet. Score eipuils the number 
nf eon eel answius. 



if 


(»i 

JV-'f -i HiiUu Hi^/ii KH) 

lu MTi'^ T3u*n»i/« ^ 3iir;3tj5rj^.'A3ll f m rt nf 

nm^^-nril, ih^' MjjU^J4f.S w n )fiih}*U4 nnnfjrtuj^ cfiDrc^ 

A hM <' i^rjunU ihe 

iiUMit^^r <''f ^«<Hi#|rr 75fir+^ ^ 

TV/ff Ji / ^^^^- >JW'^ 1 ‘.r^ly \ piifi^plfj 

"l^i^mr' '*h>^ *< i) \? i! *» in pJJ T 'j ^1*^ rj^ ^ Tuu^ of 

iriUiWiptJMh pj* ^,'^'i)!r< ') 58^ 

TrH u i5v>j'i"4/iw />!: 5f .UiV??4^2fi{v 7>U Th^ 

ntiinyi«r **h** i4 Whipplc'^^ 

vt\'T%^ rt vJ t l ^»4 Ua\,< v*jih ,% ?ii» ami 

rra>r(lr<l I«y hiiii Mh^ Jii< U*' ^orrrct 

rpprmhirhpn >?* ^ h Ms* >*!« » jti- *1 ms« ♦*{ \u 

Tr'‘i 7, {Hrh>r,i’i^^ 7'"^' ih^ MiirK> h\M wor^k 

f«iriini}$r: tlii* prMNn8JO‘4M*‘?j »'f i J^SriliMi 'i”! *-1 >U‘nM)N'(l 

*l\w prmU^il Ik* Vv,-l^ filotvku Ut'(* ^"ikp ^ t ^ivt"!i u>-uurM*‘nf* pn^iuMiiCf* 
r rirli ^u♦r^l Jk* n# ^ j *jrPv *»( *»|'f*Th liv a 

lauuungt' u r <'fci ij Mji' i>»tr«r!t Uvush l>y 

rari fuHy aM ilii* f^^iltjrrf <1 

Tr^^ S, Kfj vi?Jv A h»*t of trn 

cmimary wtmU v^m nnM a* an ii\* n r c-** Mo r^ukji-ri >\iih uinlruc- 
liunw in fixafi* xhnn linnir^^hau ly x*fti r Msih ha»l Ikoh r*‘inl, a 
InURtT liHi of t\M*iuy Horck c*^4U^>^itiimvf Ui* iui onpinak plun leu 
(tnnfu^^uin «himr)i, nfft^roil At« ou)i w^^tA m i)jo Utd It^i wan 
utlvrtMl, vUo hubp^t*! Hiiil if bt^ IomI \\< i? I^ fnro an<l '*m'' 

it ho )uu) nciL 

The relmbihly wffiwniH proHM^Utt for » nli of ilo^ (nroj^on^^ 
mcomure^ Wf*nM)l»laino8| bydn|ilira^‘ fifrjjifun Un^ of 'JV'ath 2* b.\tS 
unil by mnlclnng nli^nmto \u*u)^ in WmK 1, afliMimslo 

rolmbilUy aUuuturdft woro {u«vHumoAl u\ Uav4* Uou moi by ilto on^^maior. 

(\ UrKi'mvi; 

The moan j^orfornmnco on oarb t>f Uio )>riMa' 4 hnK Iom^ 4 wan 
BOpnraloly corn[Mitecl for oarli Kroup of fiiM*t|ora (ho HiiiM'rior, ilia 
ivverttRO, auil Iho inforior. Tnl)lo I Ih‘Io>\ MiiiOnurntaH iho aH^ioiibul 
data for nit 

Hctoro procf'otllni:^ to an InlorprriaMon *if l)io lablo, lt*i it W nnlod 
that if fipcllina ability la? ctimUluinoil liy oxcoUoiioo lo viMial jioroapliou 
then the **gooil" group «houl(l rovoal a dolinito KuponorUy ni ToM« 



Ta3le I — CoKPAaATivr PistrosiJxvcs or Tubxe of br«uu>u Asii^rrr VAHtor^ Via'lxi. Vrt>tTORT 



^ The D 'SDdi'f comparison is of course unnece^O’ ’mth the third group. 



I ,S ^ <i^ f?i<rU^ri ^ '•U l>^ U»*^ llttWf* 

^ ^ »3.' 'al'K^ « 7 rr?*K;j? Ii S 

Th'f^ ri^j'^ ‘ <1 j if <v,ir T 'if S'^'^il*) ‘A ;i7i’3 Ip^utir i?(otj[^i^( umJ^jf 

'‘t h'fM <' t -i^f I »'?,^<w( u 
of yfJKll 3]i?v ^ I* ¥; ’iTr'* k'Uceo 

gmupi' jn f f U W ©t^’h 

ill i4j^C’i«^ \f7V f< *3'^ f'"'' Jyy 1 d)^ 

U>« “1 < iv-r ri^* M ‘i rii^t^** lU Iwtft {ro!» 

ifn* if4rr?f^r V* ^u i, A^ S ;iii} i^Ai fJj* x" ^4 convrniioaal 

IViP."* r» r44?v ri-^ ^‘ji«1 < >h ih\^ ^«4mw 1 ff<Hji ihd 

mrrh»iw7»^ i i'^h '''w ji Ui,r biUf itml iW 

iiifonur " 

In Uf*' unilj'^i'ry fwn*"% (*ifivrA*T ^Ufl'^nnijiulor)* (wwcr 

vciih On* rxTtf j3li-»74 T^I Ti 'j** 7 thn uvoraRe 

frt>m Ihn 

ApimrrnUy Trrt t <>4 0^^** waiA u*^ iKi »>j4v uyo* wlurh tjui Iw 
uy^tl U* On ^ rKwn *4 TIih IchI 

e<im7nn^ii ^r<mju4 t^n' vrlyKln On‘ < 1 1 p fxi^m unnu^lmtu 
rnonuny w Ui^y U^\r «*>* 4 Ar^^nOinu in the* vvn 

tl("nr^‘ wImitIi ihH pj*i'ir4 an*! i<f'y i4 annin dmlo vw*u(il 

|^f*r(^ji!n^li c"t^rl shnithnn^iii nn^ n4nr > -’''nn i^: nr) 

An HilHriiiV tn’i4''’ On- lo *4 On^ nri)l4> m In* 

ciunjmnhjS lolul ^^^ninbr*! au \'^^'*\i iU nu4 funlilory 

UaUorin^ fiiJT tacit of nhn OiiM^ fO'iS^^y »► ll<<s*i tiiinj*;jnM»ii vwi^ 

itnidc* nn/sn^^nnd i^x f4 ‘^iW pn!^;* i"**' in * n )i n ?*! 

doh‘nidni*il, jtml \hv in^nn st^um } n ^4 t nJi utnO> Hi<»np 
acparuU'ly ccimjmlol Uw On* *=4^4 nu4i^»ry M-ro'* TIuk n 

n luoHl lulHtrinUH MfK^min^n, ^ni On^ r'iM«* 

«H>Tulnmli<in: 

TAiii»ttll, '^MbasHT^ i \^u". ni i'* I*' \V'y o 

AM* At nji'Hjii' '1 

IjV ; ti ) 4* *<^’ J 1 r-i^ii n S >114 
>it^j-.rji<»*|r \Vrf;ip<’ itlfiyjiiT 

i\ lU IlM 

I 8iuc(;^ Un5 in Ti^V S lBpffii«frnl laur^ 1 '*1 * 

\\\(^ brill |>erf<3niittnrr?< 




Vwiiml bftUt^rv \ 

t^ippruir 
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Tlic roiKi^^'nittK winch ih inlcndctl to iipjily ih: If the superior (or 
inferior) Hpellern rirr such jiniimnly hecause of high (or low) viaunl 
Iierceptiittl enpueiiy, thou tlonr relutivc |M*rforiiianc« ahould be most 
marked in the vi^iiiil MTie« Ah a mutter of fuel, the order of excel- 
lence iH nlio'il ilo’ Hume in lioth bnlteriCH flood Bpellere, uppiircnLly, 
can UHO llieir earn i)ro|H»rtmnnle|y uh cffeelively uh (heir nycH, which 
leaven uh iiiieerluiii im lii which of them* wwes (heir jirowcHH nhoiild be 
allrihulcd. 

An the method of rehiildt* differt'nreH yielded Huch ambiguoufl 
evidence, d 'wm nceesHury to uppeiil to further nnalyflia in the hope 
that thiH would reveul the (me relntionw which conceividily Imd been 
obneured by huuii' kind of eoiiifieiKiiilory munkitig. Haw corrolalionH 
Ixilween the eiiiOling Hctiren iind (he eight, leHlH were ihoreforo com- 
puted, urn! (he following eoellleientii obtiiined; 


Taiii.k hi It,'" (*011111 1 miosh iii'Taivns Pj‘BU,inii }Icoih.h ano I’EricurroAii 

'tv MM 


Tort No. 1 

Dwriplmn I 

1 

r 


1 

jm rffplnal t^\m\ 

7H 

.03 

2 


.;jo 

07 

u 


,47 ' 

07 

A 


27 

08 

♦*» 

KMhnhliUioii 

41 

07 

0 1 

Auihtory iin rinirv 

ir> 

OH 

7 : 

rrMrnirM'^HhMii 

fiK 

Oil 

H 

1 Aii<ti(orv ri'f 

43 

07 


'I'hih method heems (o elnu’k (he rennltH preKeiiled m Table I for 
ngnin lliu test of pereeptiinl npuii w predommnid Mmcc llic ? between 
apelling mid tlie dulii of 'I'esl, 1 la nKemmled by (he iinpcifecb leliabih- 
liCM of (lie ichpeedve neoren, .S|)emniiin'b coirection formula wna 
applied, reMillmg in «n i of iilmonl lit)! It uppenru llmt (he two teals 
mensiire mneli (he name fniiidioii. 

A liiml at tempi waa made to build up a legieemon eiiualioii from 
the three moat niitiHraelory vihuuI leslK, ms, Toala 1 It, ineluaivi*. 
The iimmn dVtie of iIiih lum tliiil if it emilil he nliown that admittedly 
vihUnl faetoiK poMs «h udei|uaU‘ jiredictive power for ilegieea of apollmg 
talent, tlieii they muHt he viewed an ciiuHativc innucncos thereof (in 
IIiime’H neiiHe) 'I'lie following caiculntiona me accordingly picscntotl : 





(m 

Ih'iiy' ' 

- |vi-j ^ ^ l^^rj, 

A Tj u ’' "* \ r* ** *J^ 'iifrifVifr* ffir(-{^] 

MJr,M ^ 

H vriU W f4‘»hi^ 't ^K V 3nn^i|^l< qh ViHy 

(hah thr» r^>('f!h^i*^ J!»5 i«f mj 4' r UUn-rfi* O,* ^n’f U r<f riur t^h«^ 
aihl ih^ A|w'lhf»jt lh< f.h.»M’T^r 3f» Mn! Uiijt 

<^arf3(*:f^ r'^rlup)i^» h "h^‘ J"?5J ^ jr^l^ w # 1 / ih^^is^iji 

I ( '’un» M ‘ 

Tlir ImriiUjr'^ *\ ?h *1^ *h* 7h»( tiM^ljly lend 

(Iir’tnfKr'Jv^'ft Ui ^iny rJ»-ir<ij5 3«<s'^ ’' ’j'^ -'J d, h^ti r^fU'-nh prhVi«innfll 

fipjf^ ir U^ l>so(>!,»'/j }jt "} f 1 ,^ 1 ' p3j<‘, ’»^jw Ihrijn ahilily 
la iiD rmirt* a )J v A ^r< ^ ni P ih nf ^^rnr'tiil 

aurhuiry (K»rfy»pU*»tt J* ^ n wi l-f i}tf<>^H|y 

!<> IIm* ll^A^*l’^k< ^1 Hi N ij.j,* ^ (ipjfft)ly' 

atuuhli <^f n nj^’r!ihihif?r)sll \u mm nh^* lHi)^u*it;f‘ of 

Ut^fif^alt, rjhmI pf?r^lkrvi *A Um‘ vrrM 

^)ti with (?i'^)h'iv fh-\)i N^***n*U\, ^^1‘iliiy in 

f^hlially n f>3i»^<'^h>h, h^'in^ 4 I v.\^hy r'-v faPloH 

of i\\\ optical or f’iUoHl oVOf^" iJ i -^0 i< <|U« n''.? il Hluhlly, 
lh^t^ iK^al Way Im »jMlhn^ ( ih ntsSi ^Jh*' ^ jr>i[di< or Kcritc 

nielhtirlj it wouM rM*'rio fu ir<3^^'fl^l rM’|iliihl Hpin 

Icchiittiur* hi? HM Uo r- ?!(,!« ha Uto n^lvnotiiji^* of 

bhr'vity, Kour^hl.Vi fill ^h<* ph'^' '!?jv plo*oM 1 *^' uu^Tprflf*! 

in llir* li^hl of ihr Jji-H ^11 »!o‘ Mi‘- rorn huon**, 

p<‘rfafn <0 indivoliifttfn r^hn^ni fr^o^d • j^h t*{ Ho* lojp-r npjin uu of » 
torgor curv<^ 

K MMAJO 

Tl\ia Blutly ^ontyrnnl vipJi tho ff4luv«ni?J, i\\v U \\\w 
any form <!?f v^Vimty jhmc‘‘|iUum ihUoU Ho* lonj^r il‘’h‘rmuu’r o( 
apollinmirofici^^ncy? Htx(y-Uu«'o f»\oh pr» uuuKtf^iH-c^ 

tivoly tho lUo womli omi Ho* ri4ol*Ur' h vi*hi i*f jf^^rfornnuM**', wm' 
Kivon ci^lii IrtlKiralory "rh< u fiSff f* II tuut iv^oi f!r<MUh 

one requiring the ilio virtual pEidn^aya nuA ihr mhiT <li*|M'roliriR 
on tho rceeplora far aouoii, 

Statietlwil trentmenl of llio n^tkn\iJ& iluH thr vj^^iml l>atlory 

fl* 0 whole did not diacriiinnoii^ among I ho ^muph any (w tier tliiui IIm* 




I'tnrniKn data 
\ vF,T(;n'iix<i 


{ ()X(TvUNTN(; THK KFFKCT OF 
F.XKHdSKS IN NKW-TYI’E 
r.XAMlNA’nONS 


i* \\ UMKn, 


I fl r ^ ^ 


Tin* iiwihwft <if nf U« « '»tI> i>* (<st« «lc<votci! 

ecmmdcralil'' InWir sJni tur*’ Ut ile<' rsinit's^Mji nf Mjiijui.M-illy (icpu> 
raU‘ iiMiiilly mh Ui“ l»w**m of dfifip'iliy, U'r tlt<* M'juraU* plfiiicrus 

Jlu’fr \\ lOmi n U s«* yi hik Jhih* \i r, « p<ro»K iPiKlpncy 

lo disoonliniK* Otr* un' id niijH Mrv'l »'?iI'1i(‘h hy DoiiKhmfi 

ntid SjX‘nc<'r' niul I'htt'vMil nut !» hiuli j\Jw rorndMion 

l)ctvi(?en ecorcK luw*d vijMin pufli vn'it?li«i<' jiinl p<»-P(»II('iI "iHt'rtfif'liifd” 
or raw BctircH, llinl Onw** <ijm<h uk'* fiT farli rlfniPiU, 
llitit llioy Ic'ct lo I Ik* concli)»iun Oir* r«niMilrr.'i|i!«* niiomril of oxlra 
work itivnlvrtl Iti t!»‘riviiig bimJ ii>mg vvt)g}(«f« wow uiitoTOhj-Jiry, In u 
rcccnl nrtlclo I’on'y* haw jiroKnU’il (“oiit' d nVi wlnrli rnkTcoly mii>poil 
ihla conplw»t\(»n Ho had oaoli ilom o( ti u< w-lyjw* t<'Hl m othu’ftlionttl 
iwycliolofty wolghlrjl by hix inwlnirior* ui timi Mkliy oi From tlu- 
rcttulla Ik* dotorniimHl iho rorrvIfUinnf IhHwoh raw wrorow anil tliow 
coinputrd ni^ourding lo ihow m\ fw-ritK of woiglttw, ami »l»o llio oflfocl'- 
o! Oip (Uffott'Dl wolghiliiRK tijKiik loiior loorkH into whioh ilu* U'hi 
HCO roB wort* trati»»nuio*!, F>vo of iho rtl\ f«»t‘fhiloiiiw wtih ilu* raw 
flcoroa rajiRod from .W lo ilio oilior D'ikr illl AinkroMinatoly 
oiiCHfuiirdi of llio pa|BT« worn* ilo' *■ iiin* lollor mark acfordinR 
to all seven Bcoms, and nnoilirr fonrdi onoli ucriirding i<» h)\, live, ami 
lour of the seven. The marks aroiirding ir* On* ue’tnmlnrs varied 
from thoRO hnwd on raw seoreH ni (nmi rweniy-l vo» <»> foriy*nmo 
per cent of the eaws. 

Heenuuo of llie consuleraltle (im’ign'i mein h tween (Ik-m' re«ull'' 
and othejTH prevtously ohlaiiied, ihe pn-M'ii! writer w'«h IcmI lo make 
two Hludicfl nloiiR the wiiiie hue. Hi fore |>roe< ediiiR itt preM iil Ins 
own data, however, hi* wtsheH to offer one eomnient on 1 ‘on*) ’« m\ vs(i- 

'IJoaKlntw, llnrl 1{ tirnl Peter J. SjNinrer |e It Ni'f fnpirv In Wut^lil Lxitikh 
ioHlandanlTcate? /ouwifit./ fl'if(irrtn«mr/ /’ii!,'iti((f<.v(/. Vnl XIV, !■. Itnirov, IHA 
Pl>. 100-1 VL 

’Corey, Klopliei) Mnsovell' The KKrel of IVeii^liliitK JXeriini'H in n Kew T)’pi‘ 
of libtnminBlioa .founnif o/ tfi/MoimwiiJ /WAotw. Vitl X\I. Mnv, IIMO, |>|i 
383-086 
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gfllinn Hi rlr^ rt rin> 'ipp 'if )h ariKlir*, Inil (1 k‘ WTili'r h:?sp|K*np5 Ut 
itnow ihfit I'f Uii»’ **\\ 5ip-irnrt#»rr^ r4Hrn|»itrtl of a^'ro Hoinn 

of tim HfMiM’tPip* tlnp? ihin rvuniHkrinH of fho rxiM'niiifnL 

A tf*«t whirli tiM iH?t nnuit in (k^fi'nnniinK 

lhc‘ Kcnn^ IK fnr iiW pr.irhi''^*! |inr|M>fHK nn Imm^T Ih^ K’iiin* m if 
ftll Iho rloJiH*Ji^K roun<#-t, m Orif tho r^ffr^cj of llHfi fartor 

wm? U» r Uo^ ohMOro A 

Purl of tho (hi?ji Vklnrh thr virP^T hi pn m*nl nro np(m 

a fifty rlonM^P jnoHipl* r U^i iiMth four ^«g«;oal^♦l| annwijra ta 
each rh'nuiit Hoil w;o^ lnki»n l»y MuilonlB jn cducaiioimt 

jiirBaur^^in^^nt** '1 )m* O^’no^ntN in tin* vu^r^* u|Kni five 

difTerr^nt in o-^ldPo^n «o ihi* raw 1’lirw baara wilJ )>o 

rcferrf'd to by Knb/*rri|i''^* (i^ folhov^^ 

\ r/iw fii <N3f* HUT'* 

*1 '•i IK’fr^fO^i^n rt*fr»'^llv 

a ilUlhiilu fi« ifoo JMini'^4 Oiruijj*ih lajipln lOinn of iiorninl rurve to ‘J 

i ^ nnofidll ibMobll!-' n r»f o).<* *41 five 

♦5 raioi'OM *4 ouo i»<n 

r* ro of our* (ai fuu 

It will r»”nlil.v 1 k‘ )*•<•» tli«( iIm* t»f wi'inlitiUK (‘iiiployod in iIiIh 
nx(K'niufiii wrri' MM’li {!’> lo i?i\«* ini jirttiiiiw of ngwiiu'iit hclwccn 
till* wi'iglih, lliiiK nirihiiiK (ln< coinlidoiit of tin* r*x[)i'riini‘nl mui'h 
morn unf»vor«ltli* to H-rMiniiK Inuli corrcliilioiiH iM'twocn inw iind 
ttcinlilfil iit’ort « iliiiii if w»'i«litH li!iil Ih'oii ii>*‘‘inn('(t ncconhiiK to llio 
opinioiiK of iiiHiriir(<ir>t wlio nni^lil Ih* )'\|HM'l<*tl (o iiirroo to hoido (<xl<‘nt 
At li'AMt. Not only dtO', Itiil in tin* OiiHi* of Iium's two and (liioo a liigli 
noRHlivc corrol'ilioii iiurIiI Im* >’\|M-ir(i‘il, Aint'i* om* waa liiiHed (liioolly 
upon liow t'io>v I In* i'IoiiimiIv; woo* and tin* oilier Hoimiwlnit IchH diicclly 
upon llit'ir ditInuUy ‘riio lorrel'Uinim liclwoon llu* variouH liutH of 
wciglita are giM'ii in 'I'alili' I 

Tini.r 1 t’oi iro n.’.'iH or (’omiviMTiov iihTwi.i*> Whoiith ok KohMESTn is 





I IMKT tSTl l\^ 

fll “1 
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fn 

IM 
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ra 

fji - 

n 

r„ 1-^ 
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m ^ 
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Tin* wriier’M Mo-nin! Mndy wa« aiinilai cNOciit lliuL inHlcad of the 
tlirt'O rainloin lU'fUgnnn'iitK of weiglitH, Ihrcc niHlnicloiH actually 
AHsigru'd llmin, and llini tin* wciglila for onsi* and dilhcully wmo both 
lakon on the Mann* ba-sia ao that tin* coridalion betweon thorn wtus 
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~~ I (Kt Tlv »n (l«« f'sw wa<\ n lwf'U» j-Iwm rli'iu* til nittfiliMinawfT 
U’«t in niifllimt<si t»f Uaflni-g' *H,«' nf rnmlalinji iM'lwwtn 

(hr wrip,li(H 111 Hint af<’ lU 1 nl’i" H 


Traill ft 


♦if 

tViininri 


•fn*^ nr H 




Mm 

vMf M 


fn - " 

1 r^) 

- 

ffrhi 

- r. 

*^1.1 — Hi 

rjf ^ 


- 

fy? 

m t *a 


fu « 

nf) 

- 

ff'i 



r>t ^ 

01 






U wilJ llml fxrcji’i ji» »l»i' i-f ill*' wriKyiUrijjH {irninling 

l<i pw ond iliflirully bjmI rd |t> iIp i!»t<p ifi^lnirforj*, Hu* rorn'la- 
Uons lK'(viCfn wrijdiiw jirnPhralty ppm T1ii«h<' pivi-n liy ih<j 
llmx‘ iimlnirtnnt jp^ninrlv. sn toi*' r i*>»‘ <Jr‘nili‘iUy Itiw, luid 

in llip fiOitr IWK only fmrly 

AflPr wfigldjt lm*J ii<li’ninn*d hh »(i oi nix >1, cid'li KUnti'iit’H 

M’tm* ciiirijmlpil HftnnUu^ ♦ .i»*U i*f tl«’ «u jiluni n( v^cinMnij^ 

In lht‘ fimt “Unly llit'n' hi n- iw<i iinil< r i ■n h, nni- li.v tnlulin^ the 
pninln tillipVii'il ftirsil in whit li l)i*K>i\n 'In* uirn cf iiiiHwpni, 

nnil (Ik* ollir-r i>,v iio'iiiiH of (In* ii(i|<rn\i<i| fnriiiiil’i for iiiii|(i|il<*~;iiiKm‘r 
II' ir 

Ipjflu, miK* H ,, wliiilnii (bixr/sH'lrf'tiiiiii'Hhxin' U 

111 of Pour«‘, U hIiikiIh fnr iJir* niiiiil>H<r nf riiiht n-^ixniM i*, iiml ir 
for (lie itiimlH*r of Hrmig In ilo* HtniiiJ htioly only iijk* 

liipllitiii, (III* iniiiilxT nwt'f, tt«h Tin* intoriormlnltoiiH 

Imtwcnn tlin si:*on*w on fin It of tin* Iijimh urn mvrn m Tiildn lU 
In llin InrRl half tlmmof dm firel i iM’irmn iiin urn for M'nrni Inim'iI upon 
cormcl mi'portw's only, mol dm fifo/ol fnr M’on “ li;o'*tj upon dm 
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Ta«! r.Ul 


iM' 

Itj t Vj > >.S M lilU'd 

iUel’Ii m. 



W* M WhlUHtiW^ 





Kiffii Mim1v 
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rii ^ ,0i3, ,92 
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fu ^ *0H, M 

rji iM 

Wi, -IHI 

■* Oil 



fn ^ .9U, .00 
fii ^ 90, 90 

Pit 
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^ ami Mu(l\ 



rit ^ S\7 
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7S 

rv» -- 91 
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r„ - Ui 
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ru tOH 
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U will Ih' wtii tiint unly in Hip riiw' of llic third btutis, limt ih, the 
vfciRlila dotpniHiu'fl cirrorduiK to the norinnt probnliihly rnrvo na 
applictl U> difluMilty, wcr<* llu* popflicipiila liolwocn Ihp raw acorea 
and lilt! wciglilrd uron'H lower than 07, and timl in half of tho other 
cnam m (he firnl hludy I hey are Wi, and in all the olhera m holh Hliidiea 
97 or OH Knrtherinore, aiiionK Hn’ vnrinttH Imaea of nneqiiai weight- 
ing the only ea.*>e« in whieli tin* eiwflleienlH dropped markedly lieiow 
.90 were thoKe in wliieh luotea two and tho‘e were, concerned Hucli 
a rcHult would be e^l;H■e^ed from the fact that there, wiih a fairly high 
negative correlation ladween the weighfa given on ihew' haws. Of 
the three between the diffeniil inMnietorH in the wcond atudy, two 
are decidedly higli, OK and 00, whereas (he other one ih eoiiHulcrably 
lower, lieiiig oidy 0',* 

The eominent elionhl piolnidy be iiiMTled that (he tendency of 
the (orrelalioiis and other ineitxiireH obtained from the ro.sidlH of the 
lirnt Hludy to hIiow grenter agrt enient than llioee from the kpcoikI is 
undoubtedly due to the fuel that the tent employed therein was much 
longer than dial vi^ed m llu'eeeoiid 

Kolhiwmg t 'orev'H e\aniple, the writer aluo eoniputed llui effect of 
different weights upon marks ’CIuh waH done in Ifu' eanie way na by 
('orey, eotihidering the 7 per cent liighesl HCorcH n» /I’a, (he next 24. 
per ns /)'n, die next .’fS j«t eenl «s fn, tlii' next 2J j>er cent iw 
D'h, and the lowe.st 7 j««r eenl ns A”fi. Table IV given fignren nhowing 
the, pi'r eenlK of (he pupils reeinving (he Kunie letter mark according to 
the various numbers of buses of weigliliiig 


Taiii.j IV I’cnei sTAors os Paskiis llsenvi.sii Saio, Maukk Accoiiuiau to 

l)issi,io,sr Wkioiitisub 


! 

Nnriiljrr of ilifTt'ri’Ul i 

IVKrnlngf'n Rivon naiiit' niiukfl 

of wnRlituifi; 

Firnt Htudv 1 

Hccond atiuly 

r» 

at) 


Ti 

an. .w 

•s:i 

1 

li, IH 

in 


to, 11 

H 


From dim (able it appears that iibmiL -lO per cent of the Hlude-nlH would 
have received tin* same h'tler mark iiccoidmg to all six basoa of weight- 
ing, and about anothei 35 iiei cent accor<lmg to five of the six In 
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otkr wordfl, io about tlim'-foiirtlm c/ (lii* tu'-oh wuufii ftlhrr nil, or 
all but nii€, of tho diffpri'nf wriRlifingH Iuim' kimui dio muiw' mark 
Tlip pprconlagcfl of i» wliirli (lu‘ iii«rk« at'-iRiir-d acconling 
to the (IlfTorcnt Imwa oxcepl llu* liral diffcr^'d from if ttrn- oIho di-ier- 
mined. Tliese ere aliown in Tuble V 
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A comparison of the reeiillH oblained iti llic wriler'e (wo expen- 
ments with those of Corey shows tliel they iiidlcete lutieli less dis- 
crepancy or disfigrccmonL kiweeii scores ii‘>sigued lUTordhig to 
different bases of weighting. In view of the fuel iliai (lie leslw were 
80 short, one containiriR only fifty elements mid tlio uIIk'i* only twenty- 
two, tho roflults are even more significant. To the wri((‘r tiii'y seem 
to offer very strong support of (lie conclusion tlml for iiew-tyjic lesls 
there is 80 little to be gained by uner|uiilly weighting the elementfi 
that it is not worth tho lidmr of nnsigiiiiig such weigiitH niiil rompiiting 
scores from them. The longer the test the more fully dues this enn- 
clusion hold. 
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rtii%» tinlv rif IViiviT 

In or«l<T (<i wlx'lhrr nr iint (lii*rc am raniil (HlTcrr'ru'f'H in 

nalivi* lrni(« wn ••liall Invc to iiir:wiiin' llntw* IriiifH, Jx"!, ijk Inkc llu* 
Himplf iniithr nf ililfcri'nrvs in liuiiiluTilinK la't,\wri Whilpa nml 
Indmiin Ii in b('li*’\(tl lliui iIiitc nm jM-culiaritieK m hnndwnlmR 
wlncli ran in Iikimhi'H in n nirn Tin' ijur'ilifiii ih, do thnse pcculmnlina 
run in rnr<‘«? la liidnn h•^ml^lrrl^u^g iH’ciilinr to ilwll and diffcrcul 
from that of WlnlcH? 

Iitiincdmfoly tin' firnlilfm ImtoiiH'H a larRc ono. So ninny tliinRH 
nml to Ui ronmd«*n’d 'Uicn' in tlic (|U<‘ahon of IcKibilily and Hpri'd. 
I'viiolhi r IB llio ipn Hlnm 'd r-hlln In* <piali(y Sidl anollinr ih wliat lia« 
Iwii railed liy yrrapIndojimtH '*< liarnrli'niliinicul" interprctalion Yiit 
anntlii'r i« rniiNidenilion of llic diaKno«i«of lln* liandwriliii)^ of tlio two 
rnn'H. Jii Ilia prcfteiit }*!nil> we have Ihhui compidlod lo roiilino our 
inrimry lo lln* lirwi iiucBtion, » /• , n ( 'oinpariMon of llio I/Cgibilily and 
Hprrd of ibc tlundwriluiK of Wlnloa and IiuIuiiib 

i’aoni.i.M 

Wi* have KHki'd ourt«‘hi‘-i lln“in (iucsUoiih; 

1. Uo tlu^o full* and imxnd-blood [lubaiiH wulo as K'Jiibly ns Wlnlo 
children of a like erliool Krade? 

2, Do (bey \srilo wilb llo* Hiliie Bpeed? 

M, Wlneb of (be fueiorri under eoiihulcralum have ibo RriMilcr 
mdueiice on leKiInhiy, ii‘< axe, heliool nradc, decree of White blood? 

1. Wliirli of ibe above farlorM bus the ureateal iiilluenco on spcpcl? 

d. I )<>('*• (Ills sludj indicub* that (Ik* Indian lacc ih niontnlly 
relaided? 


M vn.uHlA 

Tin* riiorndike lliindwnlini' Seale was naeil in ineasuiuig Haiiiples 
(if limulwnliii)' of Wln((*H and liidiaiiH 'I'lio ladiii' was done by 
Hlii(leii(rt in eluHsi h in ediK.alional iiieahiueineid.H. A Hiimiile was often 
rated by as many mh ten individimlt>, and (be uveiiiKO of Ibo ralinga 
taken ns ilu* ineasuri* 'I'lie spi'ed was di'termined by dividing the 
total iiuinber of letters l>y tin* total lime of wilting. Hecaueo the 
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number of cnscB of Ibe wsw wi wt* hnvi* Ix^n c-ompfillpd 

to resort to the use of Sfnreli's nnriim f»»r nrliiwl Rnides 


COMPOBlTtON OP TUK (lUnX'PH A^l> THK KTA OP MkaHIIHKMEnt 

Table I will show the rnrifll nml I’tliimiinrial roinjMtHition of (be 
groups. There wert' six humlretl lbr<N* full-bbwMl J nclwinn nnri one huii- 
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drod niuety-six itiixod'blood TiidmiiH found in iIm* I niied Slu(i>s liidiun 
Schools at Cluloccti, OkUdiuiiiu, iiud Albixpivrtpu'i Is»‘w Mpmco; 
and there wore two hundted sixty Wliiii* diiltiron l!ili,i‘ii fnnii eily mid 
suburban schools of Colorado. Table H will show Ihe medium of 
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anti ffcon'* for ihr ef>vpral Rta^lf^s ulnng with Un* fii«w»hft« tvf river- 
loppinit, whilf* Tnhlf HI will lihnw mlam romflftlioiwi found liolwtwu 
tho vwiouii fftClore under wmsidpration, i e., Ir'Kibillly, »p«Hl, aro, 
»chool Rnwin, and di*RW of bliKwJ 

Only when undorluking lo find cottflariom! I^rlwccn (Iprtw of 
blond and pirfonnwift' wba tb** mlx«’ddtliKKl Rrnufi (‘nlurRfd by some 
WhitoA «nd full-blood Indiana c^kon at rrendom 
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Taiii.i; IV, Ah Miu.tii'U, Clmnrl,^T^(>^H ron Mixei>-nw>oiH, wmi Aob 

D.iuikaiko 

1. l«*Ktlnltly (1), RMd'’ r«). tl<‘flrr»* ( I) 

(U.I) * 'tl III! »rt I 6u Hi 

X, 1 a'lriTi 

Wi'ittlit Ilf m-htHil Rfa>l<> M W WiijiMof il/'iioH' nf wItUa liloiiil r> Plfl 

tl Srnn' HiH'«l fU, Rrrt<l<' CJl, »|i'({rn< (11 KiIKl) >- V’rt 

ji I/ll Hi I 6(1 H, Jr, » - .or>7xi 

WriRlil of prliiHil Riadi’ II.V,*, Wt iRlil of dcROM" of Wliilo lilood t- “.057. 

I.NTMlI*HKrAT10N 

If Will 1 h' won upon (‘.Siiiniuufion of Tublc tl (linl llio IiulinnH, 
both full- and inixi'd-bloodK, aro niiudi oldor than ihc Wliilca. Fur a 
Bohool grade llip agcrt of llio full-blomlH run on llie uvorago llirco yearB, 
and llio mixed-bloods run four years ohtor than the WIuloB. The 
range of age for full-ldoods is from leu to twenty-three years, for 
mixi'd-blotids ih from ten to twenty-three, and for the Whiles ib from 
eight to hfteen Ilimever, iho iiieiliati mioieH of legibility for tlio 
raeinl groups are juHl alioul llie same, I'.e , full-bloodH, 1)2; mixed- 
bloods, K.8; and Whiles D.l. t)n the other hand the Hpcofl of the 
fidl-ldoods is gn'ater than that of either llio iiiixed-ldoods or llio 
Whites. In turn (he siieed of tlio mixcd-bloods is greater than timt 
of the Wliltes these iiiediaii scores for speed are respectively 00.9, 
C7.0, and 00.2 letters per minute. The reader must not conclude 
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(lull llio cliffcirnw iti eiK'^'d im Uuf- lo rau' u‘' apiN-un on I lie Hurfiice, 
Tliift will lif ilif'cni'ml Inlet on 

It will Irft Irt'tler to f'xoiiiiiio Talil' II for o rompnriHrii of Irgil)ility 
fi.cort'n anil w^irri* Ity Rtoili f for 0i»‘ r.iciisl (tr<ni|«f Ii will Ix' 

(fern hen' llinl (H<rforionnr< of lli" ^^Ill-l»lo'Oll^ mi' mi tlic wlioli) iiioro 
nearly lilii* ihe Wlnio niinoHi frmn WoTtli, lu” »h nnlic.it* il liy llio o\cr- 
lajrpiiiK) tliwn are Uioim.* of Uiv IloWi Vrr, lliry Ih)Ui 

ajijH'iir ns tnllier inferior in jn tforiunnw* In Hlnroli’ii rititioi', 'I’luiy ate 
niorc nearly liko out iticniiiuih for WltHi f» 'I'liui i« in t-ny onr Whiles 
auffer in conipanwiii with llie Sliirrh noroie If r.ir** niruir* u ilifTciTiict', 
the inixcrl-blfKidfi mifthi !<• rliow »i|* li^'llrr iijKiii t’oJii|i}iriwni (Imn the 
full-blotitia, init (hoy ilo not The wimo la truo for a|Heil The full- 
blood perforin iinrcd nn* looro innrlj like lln* Stnrrh nonon for eiKicd 
Hum an' tlic niixeiMilomlH us judunl by (ho (ivorhtppiioj 

If On* reader will ofer to TnbbK 111 and IN’, bo will see tlml llio 
grculosl cnrrolution i« finmd for nil Rrmiiat Imlwien loRibilUy nml 
Hchnol Rrtidi', and niwed aial erhuol rtnitlo with ejireplioiiH found m Ihe 
Wlulo datft Age IS a aiuull fimtor esei pting »u the ewe of the WUKcb 
where il is found to 1 k' uiariilioundy (‘orrelati'ii wiih sikicI (.'M) and 
alightly willi legibihfy ( !i-H| For Wliilt s (here lu (ho iiMiinl liigli rorre- 
Inllon botwwii ugeandRrndof f)2). {IjiohIiomIiI imtiro the inniKiiificniU 
coiTolation coeflieiemu for degree of bliuHl nod I,i*Kiliiti(y mid r'jieed 
They are respeclively anil (iJil. Mul(i|de roolhcn’iU', of eorrolii- 
lion (Table lY) wen* found ln'twoon leKibihiy mol wliool grade and 
degree, and speed, Kchool gnidr* and degree for the iiii\i'd-blood grouii. 
TliOHo an* respectively Tl and Vt' Tin m* an* not mt.v high They 
wcW cidenlaled (or Ibe pnrjaeM* of delerioiinng (he weigbl llmt eUowld 
be luangned respeedvely (o eeluiol grade and degree of While blond 
Foi I/Cgibiltly il ivill lu* w<*n (hut (he ratio for *>olioid grade ami degree 
is ion to one, and for i>{K‘ed, uIhiiiI si\ to one with (In one a iiiiiiUh 
quanlUy, IL will be w'eii ihai drgrei* of blood O’ a uiatlei of miiiiH 
fiignilicancc. Klsewliere it baa lH>en aliinvn (bat instead of degree of 
blood having the weight, il N'eiim (o liuie llu* aidialion may [lossibhi 
be duo to llic influence of eneiid iKiiIhh going with (lie degree of blood 
At any ralo degree is of extremely email weiglii 

SUMJ^AllV 

What, then, docs (hin aludy ehow? 

1. The full-blooda are on (he wholu eomewliat bitter in ](>gibih(y 
than the mixcd-blooda, and the Whites an* best of all. 
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li. Tho IiiilinriM are iia mon' nor I(’/<h fiiwdy lliau W1»1«h oxceplitig 
in Dip KiglUli Ctriuie wIkti' tlio WIiiIph pxrcl. 

0. The Kr<‘nt/'Hl fncl(»r in iiiHuotuniig erore in legilnhly and speed 
for ihe Indiniitt is Hchunl griiiU' Age Iiiik III lie eignificrtiice, and degree 
of While blwid pnielieally lui mgiuliraiiee if any. 

4. TIiih slmly dr»ea not indteale Oml 1 ntliwim are tnenlally retarded 
ill lenal aa (Ins ia sljoivn in rt'a]H*cl In aliilily in liuiulwnling. It ia 
aeon lhat with proiier traiimiK IndiaiiH nmy roniparc well with Wlutca 
m hnndwnling 



A MEASUREMENT OF TUE KN()WJ.EDGR OP 
PSVniOECKIY AND AFTER 

F{)KMAI, TRAlNIN(i 

lUO, 

'rho puriHw*' nf tiu« \\i* wtxhnl to 

find: (D Th«* nnwuinl iiH. «>ii o foinpn’hciiMM* 

cxAmmfktion in pJcmf-ni’ary rluiNtfry iK'fori* wid n/i<‘r inking a 
cnunw^ III llinl aifiijpci; Vi} Uip rrji 4 ti»<n Vi*>Jwr'*'n lln* jtwirt^b on ilic 
first nml wwiiict lakfiiR of fh«* IrM; i.'it llif* n-lftlmn Ix'tvvwn fiwl and 
(tcoond UkiiiR of lKr» U-iit ami (li“ swirt* on a coIUro ninniuJo iral; ( 4 ) 
tht* lYlflllon Iw'tHwn rmhw llui i"?, sron* i-n llir- I'jik( oxfiiniimlion 
minuH ateori' on ihf* firsl' rxniniiiation and nptihnh- at'nn*: and 

fS) tlia offi'cl. of tmintoR on <o>*t rrhaUihly 

The fiwt ami hun oxamiimdouK nh-niir'il mo) wrn< rivmi on the 
initial anti finn} iii«‘f'linR« of do* rUt*^ 'J ]ii< i xciitmintion ronsiHlpd of 
ono liuntlrerl rightron tnie-fnh>j' lU'iof iM-n! tijn-n I'crnn mnl Kloirj'H 
“Pfiycliolotty" Um rliiof lextinHik iip*'*! Tin* Wa'ilungton t'olh'gn 
AptitUKlc twt wna Riven a« u meriHiin* of eoUi gi* ajililuih'. 'fliia teat m 
made up of tlit* unuiil "iliK'lliRenro" Wnl ii» iio Tin* piilijt eh «cri' all 
motnlMW of ft rlftfts in rayelmlogy 1.1 n« tin* t”iuYtTMty of tliilifornia 
during the summer «>f Kl.W 'I Ina eour“i‘ over n ikthkI of m\ 

weeks. 

The data an* proH'iiled in Tahh'a J an*l 11 . 

TAni-a I - Ht'MMAivT oif I’lO’Oi.ums)., Mrw", ^^vvll\lo> Kniioiis or 

•Siawoi, 4h'it (?o» moirsr.. or Wuiitjov 
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The lack of ornegllgihlo cnrn'Iationa indiralo (lint In tlo rclatioiiHlnp 
ovials boUveon ibo vnrinblea we wiw mventigating. ( ‘onaidcruig llw 
corrected coelficieota alone, however, wrttiiu (ri'iula arc noticealilo. 
Thus, wluitcvor is measured by the Waalnngtun (.Jollrgo Aplilinlo lest 
hoe more in common with the firal preHcntalion of the p.sycholony 

no 
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ox«itnnalIoiitlifl.Ji willi lliclHjpt. TIuBiafolK'c'xppclwJ. “IntrlHRMico” 
should lx* a muro df'l^nniniml of tnfnrrnation iKtfom than 

attor fdrmal irainuig Wcauw nlhor fnrlora onlt'r into tlu- final cxtiminn- 
lion, f.ff., inUirral, nmn'n I ration, hablt« of Rludy, to lowcn llir* ffTf'cLof 
''mtalliKonco." 'rho lark of corrclalinn iK'twwn "hbuih" and wdlrgo 
aptitiidr aroro can lx* intorprckd in two vayp, KiIIut iniprovcrncnl 
in tliiH B|H'ci(ic coiirwo ia not, dciH'ndcnl ujhiii any of tlio factora tlmt 
tlolcrnunc "mtolligcncc" toaf, aeon* or (lio law of climtniahing roliirnB 
may mn'rato to enable llnw doing iKa^rly on (ho firnt taking of tho 

TpoLr, II SoMMAur or rsW'anKeTKD abo (Johkbct^o CoaHJir.ATios Cloum- 

CUtNTO ANP IIbUI Mill ITT OmmcTB’iTH WITH 1*1PIII MII.R KHMOIW (UxCOIe 

arorBi) r* ijj 1 'hiht, (Nihbi.(t»,i> r’a nv UnnuKacoHiKO anp 

UriiMiii.in r'» !•* iTAiie 
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evaininahoii to make greater gaiiH than tlieir more iiiforini'd olaHs- 
)iial<>H 'I'lu' IitmI and last taking of (he examiiialnm roiielate jiiHt 
nnnleralcly 1ml probalily na well as any tiui cmiree eMiniinalioiH 
(Vitainly the aeore on mir exaiuination before foiina! trannng cannot 
bo laed to prediel nlial aeoie will bi‘ made on (he huine (>\ainu)a(ion 
af(('r training 

The objeetion may be raiped that we <hd not validate our e\aimnii- 
lion. Tina oliji'otion does not vitally affeel our lesult.s, however We 
assumed that we weie iiieaauiiiig knowledgo of pHycliology w'hen w(‘ 
neleeled quealmna fioni Iho leslbook jliat aaeveiy luMiuclor does when 
he eonHlructa an itehieveinent test for giadmg pm poses. 

iMlitlier eoneluHioim that Hhould be nolisl are the following 
1. Ailhough the absolute variability on the last e\iuninulioii 
mcrea.sed over that of the fiiat, tho difference holwcon the Blandard 
doviiilioiiH m not Bigiiificant, The rulative vanulnhty ns moamiuid by 
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